2023-07-12 10:53:22,543 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 10:53:22,789 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c 2023-07-12 10:53:22,790 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-12 10:53:22,827 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 10:53:23,070 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 10:53:23,071 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa, deleteOnExit=true 2023-07-12 10:53:23,071 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 10:53:23,072 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/test.cache.data in system properties and HBase conf 2023-07-12 10:53:23,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 10:53:23,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop.log.dir in system properties and HBase conf 2023-07-12 10:53:23,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 10:53:23,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 10:53:23,075 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 10:53:23,463 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 10:53:23,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 10:53:23,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 10:53:23,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 10:53:23,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 10:53:23,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 10:53:23,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 10:53:23,481 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 10:53:23,481 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 10:53:23,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 10:53:23,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/nfs.dump.dir in system properties and HBase conf 2023-07-12 10:53:23,483 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir in system properties and HBase conf 2023-07-12 10:53:23,483 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 10:53:23,486 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 10:53:23,486 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 10:53:24,086 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 10:53:24,090 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 10:53:24,375 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 10:53:24,574 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 10:53:24,591 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:24,626 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:24,657 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir/Jetty_localhost_38495_hdfs____.i06nbf/webapp 2023-07-12 10:53:24,819 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38495 2023-07-12 10:53:24,851 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 10:53:24,851 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 10:53:25,459 WARN [Listener at localhost/37511] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 10:53:25,559 WARN [Listener at localhost/37511] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 10:53:25,579 WARN [Listener at localhost/37511] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:25,586 INFO [Listener at localhost/37511] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:25,595 INFO [Listener at localhost/37511] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir/Jetty_localhost_36561_datanode____9qo5hw/webapp 2023-07-12 10:53:25,708 INFO [Listener at localhost/37511] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36561 2023-07-12 10:53:26,232 WARN [Listener at localhost/42775] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 10:53:26,289 WARN [Listener at localhost/42775] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 10:53:26,295 WARN [Listener at localhost/42775] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:26,297 INFO [Listener at localhost/42775] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:26,309 INFO [Listener at localhost/42775] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir/Jetty_localhost_38879_datanode____kgya64/webapp 2023-07-12 10:53:26,475 INFO [Listener at localhost/42775] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38879 2023-07-12 10:53:26,508 WARN [Listener at localhost/38667] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 10:53:26,556 WARN [Listener at localhost/38667] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 10:53:26,559 WARN [Listener at localhost/38667] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:26,562 INFO [Listener at localhost/38667] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:26,573 INFO [Listener at localhost/38667] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir/Jetty_localhost_39027_datanode____654052/webapp 2023-07-12 10:53:26,720 INFO [Listener at localhost/38667] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39027 2023-07-12 10:53:26,754 WARN [Listener at localhost/38331] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 10:53:26,973 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9f578deab685283f: Processing first storage report for DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2 from datanode f38f507d-4ee0-4d4c-b3d0-f1b38c66a26d 2023-07-12 10:53:26,975 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9f578deab685283f: from storage DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2 node DatanodeRegistration(127.0.0.1:38467, datanodeUuid=f38f507d-4ee0-4d4c-b3d0-f1b38c66a26d, infoPort=34439, infoSecurePort=0, ipcPort=42775, storageInfo=lv=-57;cid=testClusterID;nsid=877177576;c=1689159204166), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 10:53:26,977 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9f578deab685283f: Processing first storage report for DS-3f20170b-53ab-4555-951c-68edb1c3c57c from datanode f38f507d-4ee0-4d4c-b3d0-f1b38c66a26d 2023-07-12 10:53:26,977 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9f578deab685283f: from storage DS-3f20170b-53ab-4555-951c-68edb1c3c57c node DatanodeRegistration(127.0.0.1:38467, datanodeUuid=f38f507d-4ee0-4d4c-b3d0-f1b38c66a26d, infoPort=34439, infoSecurePort=0, ipcPort=42775, storageInfo=lv=-57;cid=testClusterID;nsid=877177576;c=1689159204166), blocks: 0, hasStaleStorage: false, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 10:53:26,978 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf6db62dd7e814ce0: Processing first storage report for DS-9b119634-41a8-47f8-bf81-59a04b9a702e from datanode d50dac8e-6d01-4d3f-9730-7b094d0e8531 2023-07-12 10:53:26,978 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf6db62dd7e814ce0: from storage DS-9b119634-41a8-47f8-bf81-59a04b9a702e node DatanodeRegistration(127.0.0.1:38245, datanodeUuid=d50dac8e-6d01-4d3f-9730-7b094d0e8531, infoPort=35371, infoSecurePort=0, ipcPort=38667, storageInfo=lv=-57;cid=testClusterID;nsid=877177576;c=1689159204166), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 10:53:26,978 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf6db62dd7e814ce0: Processing first storage report for DS-884b48f2-b43b-4cfd-babf-4d856b907d79 from datanode d50dac8e-6d01-4d3f-9730-7b094d0e8531 2023-07-12 10:53:26,978 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf6db62dd7e814ce0: from storage DS-884b48f2-b43b-4cfd-babf-4d856b907d79 node DatanodeRegistration(127.0.0.1:38245, datanodeUuid=d50dac8e-6d01-4d3f-9730-7b094d0e8531, infoPort=35371, infoSecurePort=0, ipcPort=38667, storageInfo=lv=-57;cid=testClusterID;nsid=877177576;c=1689159204166), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 10:53:27,006 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ecbf1dc4ea1c40d: Processing first storage report for DS-67cf851f-3d27-4d81-9862-07dc26ae54ea from datanode 1dd23df2-64a8-4081-bfab-692570f24121 2023-07-12 10:53:27,006 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ecbf1dc4ea1c40d: from storage DS-67cf851f-3d27-4d81-9862-07dc26ae54ea node DatanodeRegistration(127.0.0.1:44747, datanodeUuid=1dd23df2-64a8-4081-bfab-692570f24121, infoPort=44745, infoSecurePort=0, ipcPort=38331, storageInfo=lv=-57;cid=testClusterID;nsid=877177576;c=1689159204166), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 10:53:27,007 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ecbf1dc4ea1c40d: Processing first storage report for DS-5af98e85-02b1-4c8b-8550-443841d134f5 from datanode 1dd23df2-64a8-4081-bfab-692570f24121 2023-07-12 10:53:27,007 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ecbf1dc4ea1c40d: from storage DS-5af98e85-02b1-4c8b-8550-443841d134f5 node DatanodeRegistration(127.0.0.1:44747, datanodeUuid=1dd23df2-64a8-4081-bfab-692570f24121, infoPort=44745, infoSecurePort=0, ipcPort=38331, storageInfo=lv=-57;cid=testClusterID;nsid=877177576;c=1689159204166), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 10:53:27,210 DEBUG [Listener at localhost/38331] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c 2023-07-12 10:53:27,300 INFO [Listener at localhost/38331] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/zookeeper_0, clientPort=53956, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 10:53:27,322 INFO [Listener at localhost/38331] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53956 2023-07-12 10:53:27,333 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:27,336 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:28,022 INFO [Listener at localhost/38331] util.FSUtils(471): Created version file at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 with version=8 2023-07-12 10:53:28,022 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/hbase-staging 2023-07-12 10:53:28,371 INFO [Listener at localhost/38331] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 10:53:29,055 INFO [Listener at localhost/38331] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-12 10:53:29,091 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,091 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,092 INFO [Listener at localhost/38331] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 10:53:29,092 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,092 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 10:53:29,261 INFO [Listener at localhost/38331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 10:53:29,362 DEBUG [Listener at localhost/38331] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 10:53:29,463 INFO [Listener at localhost/38331] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44397 2023-07-12 10:53:29,482 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,485 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,508 INFO [Listener at localhost/38331] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44397 connecting to ZooKeeper ensemble=127.0.0.1:53956 2023-07-12 10:53:29,563 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:443970x0, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 10:53:29,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44397-0x101591ccd120000 connected 2023-07-12 10:53:29,615 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:53:29,616 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:53:29,631 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 10:53:29,645 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44397 2023-07-12 10:53:29,646 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44397 2023-07-12 10:53:29,646 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44397 2023-07-12 10:53:29,649 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44397 2023-07-12 10:53:29,650 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44397 2023-07-12 10:53:29,657 INFO [Listener at localhost/38331] master.HMaster(444): hbase.rootdir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7, hbase.cluster.distributed=false 2023-07-12 10:53:29,731 INFO [Listener at localhost/38331] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-12 10:53:29,731 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,731 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,731 INFO [Listener at localhost/38331] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 10:53:29,732 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,732 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 10:53:29,739 INFO [Listener at localhost/38331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 10:53:29,743 INFO [Listener at localhost/38331] ipc.NettyRpcServer(120): Bind to /172.31.2.10:38185 2023-07-12 10:53:29,746 INFO [Listener at localhost/38331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 10:53:29,754 DEBUG [Listener at localhost/38331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 10:53:29,755 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,757 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,760 INFO [Listener at localhost/38331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38185 connecting to ZooKeeper ensemble=127.0.0.1:53956 2023-07-12 10:53:29,766 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:381850x0, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 10:53:29,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38185-0x101591ccd120001 connected 2023-07-12 10:53:29,768 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:53:29,769 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:53:29,770 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 10:53:29,770 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38185 2023-07-12 10:53:29,771 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38185 2023-07-12 10:53:29,772 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38185 2023-07-12 10:53:29,773 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38185 2023-07-12 10:53:29,775 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38185 2023-07-12 10:53:29,791 INFO [Listener at localhost/38331] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-12 10:53:29,792 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,792 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,792 INFO [Listener at localhost/38331] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 10:53:29,793 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,793 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 10:53:29,793 INFO [Listener at localhost/38331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 10:53:29,799 INFO [Listener at localhost/38331] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35663 2023-07-12 10:53:29,799 INFO [Listener at localhost/38331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 10:53:29,800 DEBUG [Listener at localhost/38331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 10:53:29,801 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,804 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,807 INFO [Listener at localhost/38331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35663 connecting to ZooKeeper ensemble=127.0.0.1:53956 2023-07-12 10:53:29,811 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:356630x0, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 10:53:29,812 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): regionserver:356630x0, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:53:29,814 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): regionserver:356630x0, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:53:29,815 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): regionserver:356630x0, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 10:53:29,816 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35663 2023-07-12 10:53:29,816 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35663 2023-07-12 10:53:29,817 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35663 2023-07-12 10:53:29,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35663-0x101591ccd120002 connected 2023-07-12 10:53:29,818 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35663 2023-07-12 10:53:29,819 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35663 2023-07-12 10:53:29,837 INFO [Listener at localhost/38331] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-12 10:53:29,837 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,837 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,838 INFO [Listener at localhost/38331] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 10:53:29,838 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,838 INFO [Listener at localhost/38331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 10:53:29,838 INFO [Listener at localhost/38331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 10:53:29,840 INFO [Listener at localhost/38331] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44589 2023-07-12 10:53:29,840 INFO [Listener at localhost/38331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 10:53:29,841 DEBUG [Listener at localhost/38331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 10:53:29,843 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,845 INFO [Listener at localhost/38331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,846 INFO [Listener at localhost/38331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44589 connecting to ZooKeeper ensemble=127.0.0.1:53956 2023-07-12 10:53:29,852 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:445890x0, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 10:53:29,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44589-0x101591ccd120003 connected 2023-07-12 10:53:29,853 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:53:29,853 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:53:29,854 DEBUG [Listener at localhost/38331] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 10:53:29,858 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44589 2023-07-12 10:53:29,859 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44589 2023-07-12 10:53:29,859 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44589 2023-07-12 10:53:29,864 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44589 2023-07-12 10:53:29,865 DEBUG [Listener at localhost/38331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44589 2023-07-12 10:53:29,871 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:53:29,881 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 10:53:29,884 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:53:29,913 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 10:53:29,913 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 10:53:29,914 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 10:53:29,913 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 10:53:29,915 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:29,917 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 10:53:29,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 10:53:29,920 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,44397,1689159208192 from backup master directory 2023-07-12 10:53:29,924 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:53:29,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 10:53:29,926 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 10:53:29,926 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:53:29,931 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 10:53:29,933 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 10:53:30,051 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/hbase.id with ID: 3a51b6b4-cef3-4912-a860-d58988108ef7 2023-07-12 10:53:30,105 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:30,125 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:30,213 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x382df8ad to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:30,273 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@606d6847, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:30,308 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:30,311 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 10:53:30,337 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 10:53:30,337 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 10:53:30,339 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 10:53:30,344 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 10:53:30,345 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:30,388 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/data/master/store-tmp 2023-07-12 10:53:30,456 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:30,456 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 10:53:30,456 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:53:30,456 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:53:30,456 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 10:53:30,456 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:53:30,456 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:53:30,457 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 10:53:30,458 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/WALs/jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:53:30,486 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44397%2C1689159208192, suffix=, logDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/WALs/jenkins-hbase9.apache.org,44397,1689159208192, archiveDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/oldWALs, maxLogs=10 2023-07-12 10:53:30,566 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK] 2023-07-12 10:53:30,566 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK] 2023-07-12 10:53:30,566 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK] 2023-07-12 10:53:30,578 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 10:53:30,665 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/WALs/jenkins-hbase9.apache.org,44397,1689159208192/jenkins-hbase9.apache.org%2C44397%2C1689159208192.1689159210501 2023-07-12 10:53:30,670 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK], DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK], DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK]] 2023-07-12 10:53:30,670 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:53:30,671 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:30,675 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,677 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,771 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,784 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 10:53:30,816 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 10:53:30,831 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:30,840 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,843 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,862 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,868 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:30,869 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62958997, jitterRate=-0.06183783710002899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:30,869 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 10:53:30,870 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 10:53:30,895 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 10:53:30,895 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 10:53:30,897 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 10:53:30,900 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 10:53:30,950 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 50 msec 2023-07-12 10:53:30,950 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 10:53:30,988 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 10:53:30,994 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 10:53:31,030 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 10:53:31,038 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 10:53:31,039 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 10:53:31,048 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 10:53:31,054 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 10:53:31,062 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:31,065 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 10:53:31,066 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 10:53:31,082 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 10:53:31,088 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 10:53:31,088 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 10:53:31,089 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:31,088 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 10:53:31,088 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 10:53:31,091 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,44397,1689159208192, sessionid=0x101591ccd120000, setting cluster-up flag (Was=false) 2023-07-12 10:53:31,111 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:31,130 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 10:53:31,133 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:53:31,140 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:31,146 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 10:53:31,148 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:53:31,151 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp 2023-07-12 10:53:31,171 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(951): ClusterId : 3a51b6b4-cef3-4912-a860-d58988108ef7 2023-07-12 10:53:31,171 INFO [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(951): ClusterId : 3a51b6b4-cef3-4912-a860-d58988108ef7 2023-07-12 10:53:31,171 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(951): ClusterId : 3a51b6b4-cef3-4912-a860-d58988108ef7 2023-07-12 10:53:31,179 DEBUG [RS:1;jenkins-hbase9:35663] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 10:53:31,180 DEBUG [RS:0;jenkins-hbase9:38185] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 10:53:31,179 DEBUG [RS:2;jenkins-hbase9:44589] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 10:53:31,191 DEBUG [RS:0;jenkins-hbase9:38185] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 10:53:31,191 DEBUG [RS:2;jenkins-hbase9:44589] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 10:53:31,191 DEBUG [RS:0;jenkins-hbase9:38185] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 10:53:31,191 DEBUG [RS:2;jenkins-hbase9:44589] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 10:53:31,192 DEBUG [RS:1;jenkins-hbase9:35663] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 10:53:31,192 DEBUG [RS:1;jenkins-hbase9:35663] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 10:53:31,195 DEBUG [RS:2;jenkins-hbase9:44589] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 10:53:31,196 DEBUG [RS:2;jenkins-hbase9:44589] zookeeper.ReadOnlyZKClient(139): Connect 0x5507dc1d to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:31,197 DEBUG [RS:0;jenkins-hbase9:38185] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 10:53:31,197 DEBUG [RS:1;jenkins-hbase9:35663] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 10:53:31,200 DEBUG [RS:0;jenkins-hbase9:38185] zookeeper.ReadOnlyZKClient(139): Connect 0x7f8e3899 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:31,207 DEBUG [RS:1;jenkins-hbase9:35663] zookeeper.ReadOnlyZKClient(139): Connect 0x5a04c89f to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:31,240 DEBUG [RS:2;jenkins-hbase9:44589] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a546c6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:31,241 DEBUG [RS:2;jenkins-hbase9:44589] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41f6114f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-12 10:53:31,274 DEBUG [RS:0;jenkins-hbase9:38185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a8cb90c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:31,275 DEBUG [RS:0;jenkins-hbase9:38185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d224caf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-12 10:53:31,280 DEBUG [RS:1;jenkins-hbase9:35663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d82fa7e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:31,280 DEBUG [RS:1;jenkins-hbase9:35663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67bdae03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-12 10:53:31,295 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 10:53:31,297 DEBUG [RS:0;jenkins-hbase9:38185] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:38185 2023-07-12 10:53:31,299 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:35663 2023-07-12 10:53:31,301 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:31,301 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 10:53:31,302 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:44589 2023-07-12 10:53:31,305 INFO [RS:0;jenkins-hbase9:38185] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 10:53:31,305 INFO [RS:0;jenkins-hbase9:38185] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 10:53:31,305 DEBUG [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 10:53:31,306 INFO [RS:0;jenkins-hbase9:38185] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:31,306 DEBUG [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 10:53:31,307 INFO [RS:1;jenkins-hbase9:35663] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 10:53:31,309 INFO [RS:1;jenkins-hbase9:35663] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 10:53:31,309 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 10:53:31,309 INFO [RS:1;jenkins-hbase9:35663] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:31,309 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 10:53:31,307 INFO [RS:2;jenkins-hbase9:44589] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 10:53:31,310 INFO [RS:2;jenkins-hbase9:44589] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 10:53:31,310 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 10:53:31,310 INFO [RS:2;jenkins-hbase9:44589] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:31,310 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 10:53:31,311 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,44397,1689159208192 with isa=jenkins-hbase9.apache.org/172.31.2.10:35663, startcode=1689159209791 2023-07-12 10:53:31,311 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,44397,1689159208192 with isa=jenkins-hbase9.apache.org/172.31.2.10:44589, startcode=1689159209836 2023-07-12 10:53:31,311 INFO [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,44397,1689159208192 with isa=jenkins-hbase9.apache.org/172.31.2.10:38185, startcode=1689159209730 2023-07-12 10:53:31,332 DEBUG [RS:0;jenkins-hbase9:38185] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 10:53:31,332 DEBUG [RS:2;jenkins-hbase9:44589] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 10:53:31,332 DEBUG [RS:1;jenkins-hbase9:35663] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 10:53:31,399 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34155, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 10:53:31,399 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38457, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 10:53:31,399 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60865, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 10:53:31,405 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 10:53:31,417 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44397] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 10:53:31,428 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44397] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 10:53:31,429 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44397] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 10:53:31,430 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-12 10:53:31,430 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-12 10:53:31,430 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-12 10:53:31,430 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-12 10:53:31,430 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-12 10:53:31,430 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,431 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-12 10:53:31,431 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,436 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689159241436 2023-07-12 10:53:31,442 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 10:53:31,446 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 10:53:31,447 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 10:53:31,454 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:31,455 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 10:53:31,466 DEBUG [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 10:53:31,467 WARN [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 10:53:31,466 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 10:53:31,468 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 10:53:31,468 WARN [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 10:53:31,468 WARN [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 10:53:31,472 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 10:53:31,473 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 10:53:31,473 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 10:53:31,473 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 10:53:31,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,475 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 10:53:31,477 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 10:53:31,478 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 10:53:31,483 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 10:53:31,483 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 10:53:31,486 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689159211485,5,FailOnTimeoutGroup] 2023-07-12 10:53:31,491 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689159211486,5,FailOnTimeoutGroup] 2023-07-12 10:53:31,491 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,491 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 10:53:31,493 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,493 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,523 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:31,525 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:31,525 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:53:31,556 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:31,559 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 10:53:31,562 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/info 2023-07-12 10:53:31,563 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 10:53:31,564 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:31,564 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 10:53:31,567 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/rep_barrier 2023-07-12 10:53:31,567 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 10:53:31,568 INFO [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,44397,1689159208192 with isa=jenkins-hbase9.apache.org/172.31.2.10:38185, startcode=1689159209730 2023-07-12 10:53:31,569 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,44397,1689159208192 with isa=jenkins-hbase9.apache.org/172.31.2.10:44589, startcode=1689159209836 2023-07-12 10:53:31,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:31,570 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,44397,1689159208192 with isa=jenkins-hbase9.apache.org/172.31.2.10:35663, startcode=1689159209791 2023-07-12 10:53:31,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 10:53:31,573 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/table 2023-07-12 10:53:31,574 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 10:53:31,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:31,576 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44397] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:31,577 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740 2023-07-12 10:53:31,578 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740 2023-07-12 10:53:31,582 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 10:53:31,584 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44397] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:31,585 DEBUG [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:53:31,585 DEBUG [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37511 2023-07-12 10:53:31,585 DEBUG [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 10:53:31,585 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44397] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:31,586 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 10:53:31,587 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:53:31,587 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37511 2023-07-12 10:53:31,587 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 10:53:31,588 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:53:31,589 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37511 2023-07-12 10:53:31,589 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 10:53:31,601 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:53:31,601 DEBUG [RS:2;jenkins-hbase9:44589] zookeeper.ZKUtil(162): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:31,602 WARN [RS:2;jenkins-hbase9:44589] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 10:53:31,602 DEBUG [RS:0;jenkins-hbase9:38185] zookeeper.ZKUtil(162): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:31,602 DEBUG [RS:1;jenkins-hbase9:35663] zookeeper.ZKUtil(162): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:31,602 INFO [RS:2;jenkins-hbase9:44589] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:31,602 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:31,602 WARN [RS:0;jenkins-hbase9:38185] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 10:53:31,602 WARN [RS:1;jenkins-hbase9:35663] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 10:53:31,622 INFO [RS:0;jenkins-hbase9:38185] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:31,622 INFO [RS:1;jenkins-hbase9:35663] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:31,633 DEBUG [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:31,633 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:31,637 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,44589,1689159209836] 2023-07-12 10:53:31,637 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,38185,1689159209730] 2023-07-12 10:53:31,638 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,35663,1689159209791] 2023-07-12 10:53:31,637 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:31,640 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69403121, jitterRate=0.03418709337711334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 10:53:31,640 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 10:53:31,641 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 10:53:31,641 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 10:53:31,641 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 10:53:31,641 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 10:53:31,641 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 10:53:31,645 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 10:53:31,645 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 10:53:31,648 DEBUG [RS:1;jenkins-hbase9:35663] zookeeper.ZKUtil(162): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:31,649 DEBUG [RS:1;jenkins-hbase9:35663] zookeeper.ZKUtil(162): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:31,649 DEBUG [RS:1;jenkins-hbase9:35663] zookeeper.ZKUtil(162): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:31,650 DEBUG [RS:2;jenkins-hbase9:44589] zookeeper.ZKUtil(162): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:31,651 DEBUG [RS:2;jenkins-hbase9:44589] zookeeper.ZKUtil(162): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:31,653 DEBUG [RS:0;jenkins-hbase9:38185] zookeeper.ZKUtil(162): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:31,653 DEBUG [RS:2;jenkins-hbase9:44589] zookeeper.ZKUtil(162): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:31,653 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 10:53:31,654 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 10:53:31,654 DEBUG [RS:0;jenkins-hbase9:38185] zookeeper.ZKUtil(162): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:31,655 DEBUG [RS:0;jenkins-hbase9:38185] zookeeper.ZKUtil(162): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:31,665 DEBUG [RS:0;jenkins-hbase9:38185] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 10:53:31,665 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 10:53:31,665 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 10:53:31,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 10:53:31,678 INFO [RS:2;jenkins-hbase9:44589] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 10:53:31,679 INFO [RS:1;jenkins-hbase9:35663] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 10:53:31,678 INFO [RS:0;jenkins-hbase9:38185] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 10:53:31,693 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 10:53:31,699 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 10:53:31,712 INFO [RS:1;jenkins-hbase9:35663] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 10:53:31,722 INFO [RS:0;jenkins-hbase9:38185] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 10:53:31,728 INFO [RS:1;jenkins-hbase9:35663] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 10:53:31,728 INFO [RS:1;jenkins-hbase9:35663] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,738 INFO [RS:0;jenkins-hbase9:38185] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 10:53:31,738 INFO [RS:2;jenkins-hbase9:44589] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 10:53:31,739 INFO [RS:0;jenkins-hbase9:38185] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,742 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 10:53:31,745 INFO [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 10:53:31,747 INFO [RS:2;jenkins-hbase9:44589] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 10:53:31,747 INFO [RS:2;jenkins-hbase9:44589] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,747 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 10:53:31,758 INFO [RS:0;jenkins-hbase9:38185] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,758 INFO [RS:1;jenkins-hbase9:35663] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,759 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,758 INFO [RS:2;jenkins-hbase9:44589] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,759 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,759 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,759 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,759 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,760 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-12 10:53:31,760 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,760 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,760 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,760 DEBUG [RS:0;jenkins-hbase9:38185] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,759 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,759 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,761 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,761 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,761 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,761 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,761 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,761 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,762 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,762 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-12 10:53:31,762 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,762 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,762 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-12 10:53:31,762 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,762 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,762 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,762 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,762 DEBUG [RS:1;jenkins-hbase9:35663] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,762 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,763 DEBUG [RS:2;jenkins-hbase9:44589] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,773 INFO [RS:0;jenkins-hbase9:38185] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,774 INFO [RS:0;jenkins-hbase9:38185] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,774 INFO [RS:0;jenkins-hbase9:38185] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,797 INFO [RS:1;jenkins-hbase9:35663] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,798 INFO [RS:1;jenkins-hbase9:35663] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,798 INFO [RS:1;jenkins-hbase9:35663] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,801 INFO [RS:2;jenkins-hbase9:44589] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,801 INFO [RS:2;jenkins-hbase9:44589] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,801 INFO [RS:2;jenkins-hbase9:44589] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,821 INFO [RS:0;jenkins-hbase9:38185] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 10:53:31,822 INFO [RS:2;jenkins-hbase9:44589] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 10:53:31,822 INFO [RS:1;jenkins-hbase9:35663] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 10:53:31,826 INFO [RS:0;jenkins-hbase9:38185] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38185,1689159209730-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,826 INFO [RS:2;jenkins-hbase9:44589] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44589,1689159209836-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,826 INFO [RS:1;jenkins-hbase9:35663] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35663,1689159209791-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,852 DEBUG [jenkins-hbase9:44397] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 10:53:31,857 DEBUG [jenkins-hbase9:44397] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:31,872 DEBUG [jenkins-hbase9:44397] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:31,873 DEBUG [jenkins-hbase9:44397] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:31,873 DEBUG [jenkins-hbase9:44397] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:31,873 DEBUG [jenkins-hbase9:44397] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:31,898 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,35663,1689159209791, state=OPENING 2023-07-12 10:53:31,908 INFO [RS:0;jenkins-hbase9:38185] regionserver.Replication(203): jenkins-hbase9.apache.org,38185,1689159209730 started 2023-07-12 10:53:31,908 INFO [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,38185,1689159209730, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:38185, sessionid=0x101591ccd120001 2023-07-12 10:53:31,908 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 10:53:31,912 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:31,913 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 10:53:31,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:53:31,920 DEBUG [RS:0;jenkins-hbase9:38185] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 10:53:31,920 INFO [RS:2;jenkins-hbase9:44589] regionserver.Replication(203): jenkins-hbase9.apache.org,44589,1689159209836 started 2023-07-12 10:53:31,920 DEBUG [RS:0;jenkins-hbase9:38185] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:31,920 INFO [RS:1;jenkins-hbase9:35663] regionserver.Replication(203): jenkins-hbase9.apache.org,35663,1689159209791 started 2023-07-12 10:53:31,921 DEBUG [RS:0;jenkins-hbase9:38185] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38185,1689159209730' 2023-07-12 10:53:31,921 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,44589,1689159209836, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:44589, sessionid=0x101591ccd120003 2023-07-12 10:53:31,921 DEBUG [RS:0;jenkins-hbase9:38185] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 10:53:31,921 DEBUG [RS:2;jenkins-hbase9:44589] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 10:53:31,921 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,35663,1689159209791, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:35663, sessionid=0x101591ccd120002 2023-07-12 10:53:31,921 DEBUG [RS:2;jenkins-hbase9:44589] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:31,922 DEBUG [RS:1;jenkins-hbase9:35663] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 10:53:31,922 DEBUG [RS:1;jenkins-hbase9:35663] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:31,923 DEBUG [RS:1;jenkins-hbase9:35663] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35663,1689159209791' 2023-07-12 10:53:31,923 DEBUG [RS:1;jenkins-hbase9:35663] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 10:53:31,923 DEBUG [RS:1;jenkins-hbase9:35663] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 10:53:31,924 DEBUG [RS:1;jenkins-hbase9:35663] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 10:53:31,924 DEBUG [RS:1;jenkins-hbase9:35663] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 10:53:31,924 DEBUG [RS:1;jenkins-hbase9:35663] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:31,924 DEBUG [RS:1;jenkins-hbase9:35663] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35663,1689159209791' 2023-07-12 10:53:31,924 DEBUG [RS:1;jenkins-hbase9:35663] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:31,925 DEBUG [RS:1;jenkins-hbase9:35663] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:31,925 DEBUG [RS:1;jenkins-hbase9:35663] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 10:53:31,925 INFO [RS:1;jenkins-hbase9:35663] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 10:53:31,925 INFO [RS:1;jenkins-hbase9:35663] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 10:53:31,922 DEBUG [RS:2;jenkins-hbase9:44589] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44589,1689159209836' 2023-07-12 10:53:31,923 DEBUG [RS:0;jenkins-hbase9:38185] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 10:53:31,928 DEBUG [RS:2;jenkins-hbase9:44589] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 10:53:31,928 DEBUG [RS:0;jenkins-hbase9:38185] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 10:53:31,929 DEBUG [RS:0;jenkins-hbase9:38185] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 10:53:31,929 DEBUG [RS:0;jenkins-hbase9:38185] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:31,929 DEBUG [RS:0;jenkins-hbase9:38185] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38185,1689159209730' 2023-07-12 10:53:31,929 DEBUG [RS:0;jenkins-hbase9:38185] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:31,932 DEBUG [RS:2;jenkins-hbase9:44589] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 10:53:31,932 DEBUG [RS:0;jenkins-hbase9:38185] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:31,932 DEBUG [RS:2;jenkins-hbase9:44589] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 10:53:31,932 DEBUG [RS:0;jenkins-hbase9:38185] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 10:53:31,932 DEBUG [RS:2;jenkins-hbase9:44589] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 10:53:31,932 INFO [RS:0;jenkins-hbase9:38185] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 10:53:31,933 DEBUG [RS:2;jenkins-hbase9:44589] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:31,933 INFO [RS:0;jenkins-hbase9:38185] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 10:53:31,934 DEBUG [RS:2;jenkins-hbase9:44589] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44589,1689159209836' 2023-07-12 10:53:31,935 DEBUG [RS:2;jenkins-hbase9:44589] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:31,938 DEBUG [RS:2;jenkins-hbase9:44589] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:31,942 DEBUG [RS:2;jenkins-hbase9:44589] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 10:53:31,942 INFO [RS:2;jenkins-hbase9:44589] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 10:53:31,942 INFO [RS:2;jenkins-hbase9:44589] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 10:53:32,039 INFO [RS:0;jenkins-hbase9:38185] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38185%2C1689159209730, suffix=, logDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,38185,1689159209730, archiveDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/oldWALs, maxLogs=32 2023-07-12 10:53:32,042 INFO [RS:1;jenkins-hbase9:35663] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35663%2C1689159209791, suffix=, logDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,35663,1689159209791, archiveDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/oldWALs, maxLogs=32 2023-07-12 10:53:32,048 INFO [RS:2;jenkins-hbase9:44589] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44589%2C1689159209836, suffix=, logDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,44589,1689159209836, archiveDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/oldWALs, maxLogs=32 2023-07-12 10:53:32,111 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK] 2023-07-12 10:53:32,111 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK] 2023-07-12 10:53:32,111 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK] 2023-07-12 10:53:32,131 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK] 2023-07-12 10:53:32,131 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK] 2023-07-12 10:53:32,131 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK] 2023-07-12 10:53:32,142 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK] 2023-07-12 10:53:32,142 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK] 2023-07-12 10:53:32,143 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK] 2023-07-12 10:53:32,151 INFO [RS:0;jenkins-hbase9:38185] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,38185,1689159209730/jenkins-hbase9.apache.org%2C38185%2C1689159209730.1689159212042 2023-07-12 10:53:32,158 DEBUG [RS:0;jenkins-hbase9:38185] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK], DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK], DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK]] 2023-07-12 10:53:32,163 INFO [RS:2;jenkins-hbase9:44589] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,44589,1689159209836/jenkins-hbase9.apache.org%2C44589%2C1689159209836.1689159212050 2023-07-12 10:53:32,163 INFO [RS:1;jenkins-hbase9:35663] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,35663,1689159209791/jenkins-hbase9.apache.org%2C35663%2C1689159209791.1689159212044 2023-07-12 10:53:32,164 DEBUG [RS:2;jenkins-hbase9:44589] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK], DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK], DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK]] 2023-07-12 10:53:32,164 DEBUG [RS:1;jenkins-hbase9:35663] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK], DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK], DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK]] 2023-07-12 10:53:32,164 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:32,166 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:53:32,170 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:53:32,189 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 10:53:32,189 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:32,194 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35663%2C1689159209791.meta, suffix=.meta, logDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,35663,1689159209791, archiveDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/oldWALs, maxLogs=32 2023-07-12 10:53:32,217 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK] 2023-07-12 10:53:32,217 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK] 2023-07-12 10:53:32,217 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK] 2023-07-12 10:53:32,226 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/WALs/jenkins-hbase9.apache.org,35663,1689159209791/jenkins-hbase9.apache.org%2C35663%2C1689159209791.meta.1689159212195.meta 2023-07-12 10:53:32,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38245,DS-9b119634-41a8-47f8-bf81-59a04b9a702e,DISK], DatanodeInfoWithStorage[127.0.0.1:44747,DS-67cf851f-3d27-4d81-9862-07dc26ae54ea,DISK], DatanodeInfoWithStorage[127.0.0.1:38467,DS-de2d4cd6-2263-4e39-ace2-32fc11b54bf2,DISK]] 2023-07-12 10:53:32,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:53:32,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 10:53:32,235 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:32,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 10:53:32,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 10:53:32,241 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 10:53:32,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 10:53:32,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:32,265 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 10:53:32,266 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 10:53:32,269 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 10:53:32,271 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/info 2023-07-12 10:53:32,272 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/info 2023-07-12 10:53:32,272 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 10:53:32,273 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:32,274 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 10:53:32,276 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/rep_barrier 2023-07-12 10:53:32,276 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/rep_barrier 2023-07-12 10:53:32,279 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 10:53:32,280 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:32,280 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 10:53:32,282 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/table 2023-07-12 10:53:32,282 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/table 2023-07-12 10:53:32,283 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 10:53:32,286 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:32,289 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740 2023-07-12 10:53:32,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740 2023-07-12 10:53:32,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 10:53:32,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 10:53:32,307 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71873344, jitterRate=0.07099628448486328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 10:53:32,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 10:53:32,326 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689159212142 2023-07-12 10:53:32,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 10:53:32,354 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 10:53:32,354 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,35663,1689159209791, state=OPEN 2023-07-12 10:53:32,358 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 10:53:32,358 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 10:53:32,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 10:53:32,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,35663,1689159209791 in 439 msec 2023-07-12 10:53:32,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 10:53:32,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 696 msec 2023-07-12 10:53:32,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0640 sec 2023-07-12 10:53:32,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689159212377, completionTime=-1 2023-07-12 10:53:32,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 10:53:32,377 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 10:53:32,463 DEBUG [hconnection-0x45150b13-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:32,470 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:32,514 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 10:53:32,514 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689159272514 2023-07-12 10:53:32,514 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689159332514 2023-07-12 10:53:32,515 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 136 msec 2023-07-12 10:53:32,556 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44397,1689159208192-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,556 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44397,1689159208192-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,556 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44397,1689159208192-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,558 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:44397, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,565 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,591 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 10:53:32,596 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 10:53:32,601 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:32,610 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 10:53:32,615 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:53:32,622 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:53:32,657 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0 2023-07-12 10:53:32,660 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0 empty. 2023-07-12 10:53:32,661 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0 2023-07-12 10:53:32,661 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 10:53:32,710 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:32,712 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => af740a46e6612614c6a9803efa051fe0, NAME => 'hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:53:32,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:32,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing af740a46e6612614c6a9803efa051fe0, disabling compactions & flushes 2023-07-12 10:53:32,744 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:53:32,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:53:32,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. after waiting 0 ms 2023-07-12 10:53:32,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:53:32,744 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:53:32,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for af740a46e6612614c6a9803efa051fe0: 2023-07-12 10:53:32,749 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:53:32,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689159212753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159212753"}]},"ts":"1689159212753"} 2023-07-12 10:53:32,806 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 10:53:32,809 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:53:32,815 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159212809"}]},"ts":"1689159212809"} 2023-07-12 10:53:32,824 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 10:53:32,834 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:32,835 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:32,835 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:32,835 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:32,835 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:32,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=af740a46e6612614c6a9803efa051fe0, ASSIGN}] 2023-07-12 10:53:32,843 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=af740a46e6612614c6a9803efa051fe0, ASSIGN 2023-07-12 10:53:32,852 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=af740a46e6612614c6a9803efa051fe0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44589,1689159209836; forceNewPlan=false, retain=false 2023-07-12 10:53:33,005 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 10:53:33,006 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=af740a46e6612614c6a9803efa051fe0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:33,006 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689159213005"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159213005"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159213005"}]},"ts":"1689159213005"} 2023-07-12 10:53:33,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure af740a46e6612614c6a9803efa051fe0, server=jenkins-hbase9.apache.org,44589,1689159209836}] 2023-07-12 10:53:33,167 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:33,167 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:53:33,170 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:53:33,176 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:53:33,176 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af740a46e6612614c6a9803efa051fe0, NAME => 'hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0.', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:53:33,176 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. service=AccessControlService 2023-07-12 10:53:33,177 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:33,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace af740a46e6612614c6a9803efa051fe0 2023-07-12 10:53:33,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:33,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for af740a46e6612614c6a9803efa051fe0 2023-07-12 10:53:33,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for af740a46e6612614c6a9803efa051fe0 2023-07-12 10:53:33,180 INFO [StoreOpener-af740a46e6612614c6a9803efa051fe0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region af740a46e6612614c6a9803efa051fe0 2023-07-12 10:53:33,182 DEBUG [StoreOpener-af740a46e6612614c6a9803efa051fe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0/info 2023-07-12 10:53:33,182 DEBUG [StoreOpener-af740a46e6612614c6a9803efa051fe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0/info 2023-07-12 10:53:33,182 INFO [StoreOpener-af740a46e6612614c6a9803efa051fe0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af740a46e6612614c6a9803efa051fe0 columnFamilyName info 2023-07-12 10:53:33,183 INFO [StoreOpener-af740a46e6612614c6a9803efa051fe0-1] regionserver.HStore(310): Store=af740a46e6612614c6a9803efa051fe0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:33,185 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0 2023-07-12 10:53:33,186 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0 2023-07-12 10:53:33,189 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for af740a46e6612614c6a9803efa051fe0 2023-07-12 10:53:33,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:33,193 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened af740a46e6612614c6a9803efa051fe0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61592618, jitterRate=-0.08219847083091736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:33,194 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for af740a46e6612614c6a9803efa051fe0: 2023-07-12 10:53:33,197 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0., pid=6, masterSystemTime=1689159213166 2023-07-12 10:53:33,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:53:33,202 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:53:33,204 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=af740a46e6612614c6a9803efa051fe0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:33,204 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689159213203"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159213203"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159213203"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159213203"}]},"ts":"1689159213203"} 2023-07-12 10:53:33,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 10:53:33,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure af740a46e6612614c6a9803efa051fe0, server=jenkins-hbase9.apache.org,44589,1689159209836 in 197 msec 2023-07-12 10:53:33,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 10:53:33,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=af740a46e6612614c6a9803efa051fe0, ASSIGN in 375 msec 2023-07-12 10:53:33,219 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:53:33,219 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159213219"}]},"ts":"1689159213219"} 2023-07-12 10:53:33,222 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 10:53:33,225 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:53:33,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 624 msec 2023-07-12 10:53:33,314 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 10:53:33,316 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 10:53:33,317 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:33,347 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:33,348 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:33,367 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 10:53:33,394 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 10:53:33,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 45 msec 2023-07-12 10:53:33,412 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 10:53:33,426 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 10:53:33,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-12 10:53:33,439 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 10:53:33,442 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 10:53:33,443 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.516sec 2023-07-12 10:53:33,446 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 10:53:33,447 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 10:53:33,448 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 10:53:33,449 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44397,1689159208192-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 10:53:33,450 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44397,1689159208192-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 10:53:33,473 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:33,477 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 10:53:33,480 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:53:33,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:53:33,485 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 10:53:33,485 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:53:33,487 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c empty. 2023-07-12 10:53:33,490 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:53:33,490 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 10:53:33,491 DEBUG [Listener at localhost/38331] zookeeper.ReadOnlyZKClient(139): Connect 0x504158e6 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:33,501 DEBUG [Listener at localhost/38331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40bb1f00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:33,502 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 10:53:33,540 DEBUG [hconnection-0x2968fc28-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:33,543 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:33,547 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => a9e5eb70b4f0cd1cb790220b33a5d27c, NAME => 'hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:53:33,561 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:33,567 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:53:33,567 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 10:53:33,568 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/test.cache.data in system properties and HBase conf 2023-07-12 10:53:33,568 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 10:53:33,568 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop.log.dir in system properties and HBase conf 2023-07-12 10:53:33,568 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 10:53:33,568 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 10:53:33,568 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 10:53:33,569 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 10:53:33,569 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 10:53:33,569 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 10:53:33,569 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 10:53:33,569 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 10:53:33,569 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 10:53:33,570 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 10:53:33,570 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 10:53:33,570 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 10:53:33,570 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/nfs.dump.dir in system properties and HBase conf 2023-07-12 10:53:33,570 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir in system properties and HBase conf 2023-07-12 10:53:33,570 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 10:53:33,570 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 10:53:33,571 INFO [Listener at localhost/38331] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 10:53:33,608 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:33,608 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing a9e5eb70b4f0cd1cb790220b33a5d27c, disabling compactions & flushes 2023-07-12 10:53:33,608 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:53:33,608 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:53:33,608 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. after waiting 0 ms 2023-07-12 10:53:33,608 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:53:33,608 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:53:33,608 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for a9e5eb70b4f0cd1cb790220b33a5d27c: 2023-07-12 10:53:33,608 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 10:53:33,627 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:53:33,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689159213637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159213637"}]},"ts":"1689159213637"} 2023-07-12 10:53:33,642 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 10:53:33,645 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:53:33,645 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159213645"}]},"ts":"1689159213645"} 2023-07-12 10:53:33,655 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 10:53:33,659 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:33,661 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:33,661 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:33,661 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:33,661 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:33,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a9e5eb70b4f0cd1cb790220b33a5d27c, ASSIGN}] 2023-07-12 10:53:33,673 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a9e5eb70b4f0cd1cb790220b33a5d27c, ASSIGN 2023-07-12 10:53:33,676 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=a9e5eb70b4f0cd1cb790220b33a5d27c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35663,1689159209791; forceNewPlan=false, retain=false 2023-07-12 10:53:33,816 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 10:53:33,826 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 10:53:33,827 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a9e5eb70b4f0cd1cb790220b33a5d27c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:33,827 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689159213827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159213827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159213827"}]},"ts":"1689159213827"} 2023-07-12 10:53:33,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a9e5eb70b4f0cd1cb790220b33a5d27c, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:53:33,993 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:53:33,993 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a9e5eb70b4f0cd1cb790220b33a5d27c, NAME => 'hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c.', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:53:33,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. service=AccessControlService 2023-07-12 10:53:33,994 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:33,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:53:33,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:33,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:53:33,995 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:53:33,997 INFO [StoreOpener-a9e5eb70b4f0cd1cb790220b33a5d27c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:53:34,000 DEBUG [StoreOpener-a9e5eb70b4f0cd1cb790220b33a5d27c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c/l 2023-07-12 10:53:34,000 DEBUG [StoreOpener-a9e5eb70b4f0cd1cb790220b33a5d27c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c/l 2023-07-12 10:53:34,000 INFO [StoreOpener-a9e5eb70b4f0cd1cb790220b33a5d27c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9e5eb70b4f0cd1cb790220b33a5d27c columnFamilyName l 2023-07-12 10:53:34,001 INFO [StoreOpener-a9e5eb70b4f0cd1cb790220b33a5d27c-1] regionserver.HStore(310): Store=a9e5eb70b4f0cd1cb790220b33a5d27c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:34,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:53:34,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:53:34,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:53:34,038 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:34,041 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a9e5eb70b4f0cd1cb790220b33a5d27c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70583109, jitterRate=0.05177028477191925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:34,042 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a9e5eb70b4f0cd1cb790220b33a5d27c: 2023-07-12 10:53:34,044 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c., pid=11, masterSystemTime=1689159213986 2023-07-12 10:53:34,048 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:53:34,048 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:53:34,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a9e5eb70b4f0cd1cb790220b33a5d27c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:34,053 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689159214052"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159214052"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159214052"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159214052"}]},"ts":"1689159214052"} 2023-07-12 10:53:34,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 10:53:34,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a9e5eb70b4f0cd1cb790220b33a5d27c, server=jenkins-hbase9.apache.org,35663,1689159209791 in 225 msec 2023-07-12 10:53:34,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 10:53:34,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=a9e5eb70b4f0cd1cb790220b33a5d27c, ASSIGN in 402 msec 2023-07-12 10:53:34,073 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:53:34,073 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159214073"}]},"ts":"1689159214073"} 2023-07-12 10:53:34,077 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 10:53:34,089 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:53:34,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 616 msec 2023-07-12 10:53:34,116 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 10:53:34,117 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 10:53:34,141 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 10:53:34,872 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:35,174 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:35,179 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_40765_jobhistory____.o76jsy/webapp 2023-07-12 10:53:35,343 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 10:53:35,343 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 10:53:35,343 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 10:53:35,346 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 10:53:35,414 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:35,686 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:36,089 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 10:53:36,153 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:40765 2023-07-12 10:53:36,361 WARN [Listener at jenkins-hbase9.apache.org/45205] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:36,733 WARN [Listener at jenkins-hbase9.apache.org/45205] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 10:53:36,734 INFO [Listener at jenkins-hbase9.apache.org/45205] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:36,744 INFO [Listener at jenkins-hbase9.apache.org/45205] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_34917_cluster____.3uyy7p/webapp 2023-07-12 10:53:36,837 INFO [Listener at jenkins-hbase9.apache.org/45205] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 10:53:36,837 INFO [Listener at jenkins-hbase9.apache.org/45205] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 10:53:36,837 INFO [Listener at jenkins-hbase9.apache.org/45205] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 10:53:36,837 INFO [Listener at jenkins-hbase9.apache.org/45205] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 10:53:36,847 INFO [Listener at jenkins-hbase9.apache.org/45205] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:37,093 INFO [Listener at jenkins-hbase9.apache.org/45205] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:37,279 INFO [Listener at jenkins-hbase9.apache.org/45205] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:37,369 INFO [Listener at jenkins-hbase9.apache.org/45205] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:34917 2023-07-12 10:53:38,042 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:53:38,255 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 10:53:38,257 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 10:53:38,258 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 10:53:38,270 WARN [Listener at jenkins-hbase9.apache.org/37891] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:38,294 WARN [Listener at jenkins-hbase9.apache.org/37891] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 10:53:38,295 INFO [Listener at jenkins-hbase9.apache.org/37891] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:38,299 INFO [Listener at jenkins-hbase9.apache.org/37891] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_33239_node____6ksdqp/webapp 2023-07-12 10:53:38,357 INFO [Listener at jenkins-hbase9.apache.org/37891] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 10:53:38,357 INFO [Listener at jenkins-hbase9.apache.org/37891] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 10:53:38,357 INFO [Listener at jenkins-hbase9.apache.org/37891] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 10:53:38,357 INFO [Listener at jenkins-hbase9.apache.org/37891] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 10:53:38,364 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:38,365 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 10:53:38,365 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:38,365 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 10:53:38,365 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 10:53:38,365 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 10:53:38,366 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:38,366 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 10:53:38,366 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 10:53:38,366 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 10:53:38,368 INFO [Listener at jenkins-hbase9.apache.org/37891] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,396 INFO [Listener at jenkins-hbase9.apache.org/37891] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,489 INFO [Listener at jenkins-hbase9.apache.org/37891] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,505 INFO [Listener at jenkins-hbase9.apache.org/37891] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:33239 2023-07-12 10:53:38,745 WARN [Listener at jenkins-hbase9.apache.org/37221] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:38,751 WARN [Listener at jenkins-hbase9.apache.org/37221] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 10:53:38,752 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:38,759 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_34421_node____.lfirat/webapp 2023-07-12 10:53:38,813 INFO [Listener at jenkins-hbase9.apache.org/37221] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 10:53:38,813 INFO [Listener at jenkins-hbase9.apache.org/37221] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 10:53:38,813 INFO [Listener at jenkins-hbase9.apache.org/37221] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 10:53:38,814 INFO [Listener at jenkins-hbase9.apache.org/37221] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 10:53:38,821 INFO [Listener at jenkins-hbase9.apache.org/37221] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,836 INFO [Listener at jenkins-hbase9.apache.org/37221] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,931 INFO [Listener at jenkins-hbase9.apache.org/37221] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,940 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:34421 2023-07-12 10:53:38,970 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 10:53:38,972 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:39,039 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=385, ProcessCount=172, AvailableMemoryMB=8241 2023-07-12 10:53:39,039 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-12 10:53:39,055 DEBUG [Listener at jenkins-hbase9.apache.org/37221] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 10:53:39,062 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 10:53:39,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:39,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:39,075 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:53:39,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 10:53:39,077 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:53:39,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:39,084 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916 2023-07-12 10:53:39,084 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:39,085 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916 empty. 2023-07-12 10:53:39,085 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc empty. 2023-07-12 10:53:39,086 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916 2023-07-12 10:53:39,086 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:39,086 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 10:53:39,133 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:39,137 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec107d91012c3404601499381bfce916, NAME => 'testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:53:39,137 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => dec82ae7408512f9689bb1f7d8e4a5bc, NAME => 'testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:53:39,192 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:39,192 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing dec82ae7408512f9689bb1f7d8e4a5bc, disabling compactions & flushes 2023-07-12 10:53:39,192 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:39,192 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:39,192 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. after waiting 0 ms 2023-07-12 10:53:39,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:39,192 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:39,195 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:39,195 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for dec82ae7408512f9689bb1f7d8e4a5bc: 2023-07-12 10:53:39,203 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:39,203 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing ec107d91012c3404601499381bfce916, disabling compactions & flushes 2023-07-12 10:53:39,203 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:39,203 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:39,203 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. after waiting 0 ms 2023-07-12 10:53:39,203 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:39,203 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:39,203 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for ec107d91012c3404601499381bfce916: 2023-07-12 10:53:39,209 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:53:39,210 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159219210"}]},"ts":"1689159219210"} 2023-07-12 10:53:39,210 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159219210"}]},"ts":"1689159219210"} 2023-07-12 10:53:39,268 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:53:39,270 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:53:39,271 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159219271"}]},"ts":"1689159219271"} 2023-07-12 10:53:39,275 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 10:53:39,282 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:39,288 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:39,288 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:39,288 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:39,288 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:39,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ec107d91012c3404601499381bfce916, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dec82ae7408512f9689bb1f7d8e4a5bc, ASSIGN}] 2023-07-12 10:53:39,292 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ec107d91012c3404601499381bfce916, ASSIGN 2023-07-12 10:53:39,293 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dec82ae7408512f9689bb1f7d8e4a5bc, ASSIGN 2023-07-12 10:53:39,295 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ec107d91012c3404601499381bfce916, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44589,1689159209836; forceNewPlan=false, retain=false 2023-07-12 10:53:39,295 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dec82ae7408512f9689bb1f7d8e4a5bc, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38185,1689159209730; forceNewPlan=false, retain=false 2023-07-12 10:53:39,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:39,445 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:53:39,448 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dec82ae7408512f9689bb1f7d8e4a5bc, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:39,448 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ec107d91012c3404601499381bfce916, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:39,448 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219448"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159219448"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159219448"}]},"ts":"1689159219448"} 2023-07-12 10:53:39,448 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219448"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159219448"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159219448"}]},"ts":"1689159219448"} 2023-07-12 10:53:39,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure dec82ae7408512f9689bb1f7d8e4a5bc, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:53:39,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure ec107d91012c3404601499381bfce916, server=jenkins-hbase9.apache.org,44589,1689159209836}] 2023-07-12 10:53:39,607 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:39,607 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:53:39,611 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:53:39,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:39,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec107d91012c3404601499381bfce916, NAME => 'testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:53:39,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. service=AccessControlService 2023-07-12 10:53:39,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:39,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ec107d91012c3404601499381bfce916 2023-07-12 10:53:39,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:39,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ec107d91012c3404601499381bfce916 2023-07-12 10:53:39,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ec107d91012c3404601499381bfce916 2023-07-12 10:53:39,626 INFO [StoreOpener-ec107d91012c3404601499381bfce916-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec107d91012c3404601499381bfce916 2023-07-12 10:53:39,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:39,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dec82ae7408512f9689bb1f7d8e4a5bc, NAME => 'testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:53:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. service=AccessControlService 2023-07-12 10:53:39,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:39,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:39,630 DEBUG [StoreOpener-ec107d91012c3404601499381bfce916-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/cf 2023-07-12 10:53:39,630 DEBUG [StoreOpener-ec107d91012c3404601499381bfce916-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/cf 2023-07-12 10:53:39,631 INFO [StoreOpener-ec107d91012c3404601499381bfce916-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec107d91012c3404601499381bfce916 columnFamilyName cf 2023-07-12 10:53:39,632 INFO [StoreOpener-ec107d91012c3404601499381bfce916-1] regionserver.HStore(310): Store=ec107d91012c3404601499381bfce916/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:39,632 INFO [StoreOpener-dec82ae7408512f9689bb1f7d8e4a5bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:39,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916 2023-07-12 10:53:39,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916 2023-07-12 10:53:39,635 DEBUG [StoreOpener-dec82ae7408512f9689bb1f7d8e4a5bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/cf 2023-07-12 10:53:39,635 DEBUG [StoreOpener-dec82ae7408512f9689bb1f7d8e4a5bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/cf 2023-07-12 10:53:39,636 INFO [StoreOpener-dec82ae7408512f9689bb1f7d8e4a5bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dec82ae7408512f9689bb1f7d8e4a5bc columnFamilyName cf 2023-07-12 10:53:39,637 INFO [StoreOpener-dec82ae7408512f9689bb1f7d8e4a5bc-1] regionserver.HStore(310): Store=dec82ae7408512f9689bb1f7d8e4a5bc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:39,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:39,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:39,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ec107d91012c3404601499381bfce916 2023-07-12 10:53:39,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:39,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:39,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ec107d91012c3404601499381bfce916; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74472427, jitterRate=0.10972563922405243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:39,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ec107d91012c3404601499381bfce916: 2023-07-12 10:53:39,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916., pid=16, masterSystemTime=1689159219607 2023-07-12 10:53:39,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:39,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:39,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:39,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened dec82ae7408512f9689bb1f7d8e4a5bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74746459, jitterRate=0.11380903422832489}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:39,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for dec82ae7408512f9689bb1f7d8e4a5bc: 2023-07-12 10:53:39,659 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ec107d91012c3404601499381bfce916, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:39,659 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219658"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159219658"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159219658"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159219658"}]},"ts":"1689159219658"} 2023-07-12 10:53:39,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc., pid=15, masterSystemTime=1689159219607 2023-07-12 10:53:39,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:39,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:39,669 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=dec82ae7408512f9689bb1f7d8e4a5bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:39,670 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219669"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159219669"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159219669"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159219669"}]},"ts":"1689159219669"} 2023-07-12 10:53:39,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 10:53:39,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure ec107d91012c3404601499381bfce916, server=jenkins-hbase9.apache.org,44589,1689159209836 in 212 msec 2023-07-12 10:53:39,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ec107d91012c3404601499381bfce916, ASSIGN in 382 msec 2023-07-12 10:53:39,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 10:53:39,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure dec82ae7408512f9689bb1f7d8e4a5bc, server=jenkins-hbase9.apache.org,38185,1689159209730 in 222 msec 2023-07-12 10:53:39,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-12 10:53:39,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dec82ae7408512f9689bb1f7d8e4a5bc, ASSIGN in 392 msec 2023-07-12 10:53:39,690 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:53:39,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159219690"}]},"ts":"1689159219690"} 2023-07-12 10:53:39,693 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 10:53:39,697 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:53:39,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:39,704 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 10:53:39,731 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 10:53:39,767 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:39,767 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:39,767 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:39,767 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:39,767 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:39,779 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:39,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:39,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:39,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:39,780 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:39,783 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 710 msec 2023-07-12 10:53:40,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:40,201 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 10:53:40,201 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-12 10:53:40,202 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:40,207 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-12 10:53:40,208 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:40,208 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-12 10:53:40,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:40,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159220223 (current time:1689159220223). 2023-07-12 10:53:40,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:53:40,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x5c3b5e2e to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:40,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dfe45f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:40,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:40,238 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:40,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c3b5e2e to 127.0.0.1:53956 2023-07-12 10:53:40,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:40,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x281929a6 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:40,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ef2a1e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:40,253 DEBUG [hconnection-0x57f3c375-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:40,256 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:40,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x281929a6 to 127.0.0.1:53956 2023-07-12 10:53:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 10:53:40,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:53:40,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:40,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:40,310 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:40,311 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689159820311 2023-07-12 10:53:40,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:40,312 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 10:53:40,315 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:40,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:40,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-12 10:53:40,319 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:40,320 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:53:40,320 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:53:40,321 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689159820321 2023-07-12 10:53:40,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,354 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 10:53:40,354 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:40,355 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 10:53:40,355 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 10:53:40,356 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,356 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,362 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,362 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,362 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,362 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,362 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,363 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,363 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,363 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:53:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 10:53:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 10:53:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 10:53:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,365 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:40,365 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:40,365 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:40,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,368 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:40,368 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:40,368 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:40,369 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:40,369 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:40,369 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:40,369 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:40,370 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:40,370 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:40,370 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:40,370 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:40,370 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:40,371 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:40,371 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:40,371 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:40,373 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,375 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,375 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,375 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,375 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,375 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,375 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,375 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,375 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:40,376 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,376 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:40,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 10:53:40,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@738fb5c6[Count = 1] remaining members to acquire global barrier 2023-07-12 10:53:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 10:53:40,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@738fb5c6[Count = 0] remaining members to acquire global barrier 2023-07-12 10:53:40,384 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 10:53:40,384 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,386 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,386 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,386 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,386 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,387 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:40,387 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:53:40,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,387 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:40,387 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,387 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,388 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:53:40,392 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:40,393 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:40,393 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:40,393 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:40,393 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:40,393 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:40,393 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:40,393 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:40,393 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:40,393 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:40,394 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. started... 2023-07-12 10:53:40,395 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. started... 2023-07-12 10:53:40,398 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dec82ae7408512f9689bb1f7d8e4a5bc: 2023-07-12 10:53:40,398 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec107d91012c3404601499381bfce916: 2023-07-12 10:53:40,399 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,399 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,405 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:40,405 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:40,409 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:53:40,409 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:53:40,420 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:40,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:40,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:40,427 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:53:40,438 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. completed. 2023-07-12 10:53:40,438 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:40,439 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:40,439 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:40,439 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,441 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:40,442 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:53:40,447 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,447 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:40,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,447 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:40,447 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:40,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,451 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. completed. 2023-07-12 10:53:40,451 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:40,451 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:40,451 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:40,451 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,451 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:40,451 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:53:40,453 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:40,453 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:40,453 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:40,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,455 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:53:40,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 10:53:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44589,1689159209836': 2023-07-12 10:53:40,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 10:53:40,471 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 10:53:40,471 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:53:40,471 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:53:40,471 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,471 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:53:40,474 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,474 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,474 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,474 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,475 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,475 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,475 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,476 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,476 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,477 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,487 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,488 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,495 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,513 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,513 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,513 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,514 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:40,514 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,515 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:40,515 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:40,515 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,515 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,514 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:40,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,627 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:40,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:40,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:40,631 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:53:40,706 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 10:53:40,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,707 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689159220312Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689159220514 (+202 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689159220516 (+2 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689159220543 (+27 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689159220581 (+38 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689159220706 (+125 ms) 2023-07-12 10:53:40,710 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:40,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 396 msec 2023-07-12 10:53:40,931 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:40,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:40,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:53:40,952 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:40,952 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:40,959 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:40,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44589] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:53:40,962 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:40,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38185] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:53:40,970 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 10:53:40,971 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:40,973 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:41,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:41,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159221002 (current time:1689159221002). 2023-07-12 10:53:41,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:53:41,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x7595e8c6 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:41,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79e48662, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:41,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:41,014 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:41,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7595e8c6 to 127.0.0.1:53956 2023-07-12 10:53:41,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:41,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x4251ce9e to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:41,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18d8cdca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:41,026 DEBUG [hconnection-0x45528f25-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:41,028 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:41,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4251ce9e to 127.0.0.1:53956 2023-07-12 10:53:41,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:41,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 10:53:41,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:53:41,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:41,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:41,039 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:41,041 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689159821041 2023-07-12 10:53:41,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:41,041 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 10:53:41,042 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:53:41,043 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:53:41,044 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:41,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:41,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-12 10:53:41,047 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:41,048 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689159821048 2023-07-12 10:53:41,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 10:53:41,085 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 10:53:41,085 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:41,086 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 10:53:41,086 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 10:53:41,087 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,087 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,088 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,088 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,089 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,088 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,089 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,090 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,090 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,090 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:53:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 10:53:41,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 10:53:41,090 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 10:53:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,091 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:41,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 10:53:41,091 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:41,091 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:41,091 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:41,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 10:53:41,092 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:41,092 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:41,092 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:41,092 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:41,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 10:53:41,092 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:41,092 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:41,093 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:41,093 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:41,093 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:41,094 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:41,094 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:41,094 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:41,094 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:41,097 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,098 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,098 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,098 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,099 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:41,100 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,100 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:41,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,100 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,100 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,101 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,101 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 10:53:41,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a4db407[Count = 1] remaining members to acquire global barrier 2023-07-12 10:53:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 10:53:41,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a4db407[Count = 0] remaining members to acquire global barrier 2023-07-12 10:53:41,118 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 10:53:41,119 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,125 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,125 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,125 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,125 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,125 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:41,125 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:41,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,126 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:41,126 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:41,126 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,126 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:53:41,126 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:53:41,126 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:41,126 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:41,127 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:41,127 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. started... 2023-07-12 10:53:41,127 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dec82ae7408512f9689bb1f7d8e4a5bc 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 10:53:41,128 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:41,130 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:41,133 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:41,133 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:41,134 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. started... 2023-07-12 10:53:41,134 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:41,134 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:41,135 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ec107d91012c3404601499381bfce916 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 10:53:41,143 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:41,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:41,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:41,145 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:53:41,250 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/.tmp/cf/8444b55bedde4bf182e8c310416b5377 2023-07-12 10:53:41,256 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/.tmp/cf/5ca7ddb3c06d4a5cb131a003ecda469c 2023-07-12 10:53:41,303 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/.tmp/cf/5ca7ddb3c06d4a5cb131a003ecda469c as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/cf/5ca7ddb3c06d4a5cb131a003ecda469c 2023-07-12 10:53:41,303 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/.tmp/cf/8444b55bedde4bf182e8c310416b5377 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/cf/8444b55bedde4bf182e8c310416b5377 2023-07-12 10:53:41,314 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/cf/8444b55bedde4bf182e8c310416b5377, entries=47, sequenceid=6, filesize=8.0 K 2023-07-12 10:53:41,315 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/cf/5ca7ddb3c06d4a5cb131a003ecda469c, entries=3, sequenceid=6, filesize=5.0 K 2023-07-12 10:53:41,319 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ec107d91012c3404601499381bfce916 in 184ms, sequenceid=6, compaction requested=false 2023-07-12 10:53:41,319 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for dec82ae7408512f9689bb1f7d8e4a5bc in 192ms, sequenceid=6, compaction requested=false 2023-07-12 10:53:41,319 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 10:53:41,319 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 10:53:41,322 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec107d91012c3404601499381bfce916: 2023-07-12 10:53:41,322 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dec82ae7408512f9689bb1f7d8e4a5bc: 2023-07-12 10:53:41,322 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 10:53:41,322 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 10:53:41,323 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:41,323 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:41,323 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/cf/5ca7ddb3c06d4a5cb131a003ecda469c] hfiles 2023-07-12 10:53:41,323 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/cf/8444b55bedde4bf182e8c310416b5377] hfiles 2023-07-12 10:53:41,323 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/cf/5ca7ddb3c06d4a5cb131a003ecda469c for snapshot=snaptb0-testExportWithTargetName 2023-07-12 10:53:41,323 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/cf/8444b55bedde4bf182e8c310416b5377 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 10:53:41,345 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:41,352 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. completed. 2023-07-12 10:53:41,352 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:41,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:41,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:41,353 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:53:41,357 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:41,357 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:41,358 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,358 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:41,358 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:53:41,360 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,360 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,360 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:41,360 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,363 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. completed. 2023-07-12 10:53:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,363 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:41,363 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:41,363 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:41,363 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,363 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:41,363 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:53:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,365 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,365 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,365 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:41,365 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44589,1689159209836': 2023-07-12 10:53:41,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 10:53:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:53:41,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 10:53:41,373 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 10:53:41,373 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:53:41,373 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:53:41,373 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 10:53:41,373 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:53:41,376 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,376 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,376 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,376 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,376 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,377 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,377 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,377 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,378 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,379 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,382 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,382 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,383 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,393 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,393 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,393 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,393 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,394 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,394 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 10:53:41,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,393 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,393 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,393 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,394 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 10:53:41,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,394 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:41,394 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,395 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,395 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:41,396 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,396 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:41,396 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:41,396 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,396 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 10:53:41,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,500 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689159221041Consolidate snapshot: snaptb0-testExportWithTargetName at 1689159221394 (+353 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689159221394Writing data manifest for snaptb0-testExportWithTargetName at 1689159221400 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689159221427 (+27 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689159221500 (+73 ms) 2023-07-12 10:53:41,503 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:41,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 461 msec 2023-07-12 10:53:41,654 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:41,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:41,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:53:41,657 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657 2023-07-12 10:53:41,657 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37511, tgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657, rawTgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657, srcFsUri=hdfs://localhost:37511, srcDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:53:41,700 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:53:41,700 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1760069220_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 10:53:41,700 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7, snapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 10:53:41,719 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 10:53:41,810 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,811 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,812 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,812 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,813 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,814 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,814 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,896 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop-995062372704075561.jar 2023-07-12 10:53:41,897 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,897 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,898 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,898 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,899 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,899 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:41,899 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:53:41,900 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:53:41,900 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:53:41,901 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:53:41,901 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:53:41,902 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:53:41,902 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:53:41,903 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:53:41,903 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:53:41,903 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:53:41,907 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:41,907 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:41,907 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:53:41,908 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:41,908 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:41,908 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:53:41,909 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:53:43,426 WARN [Listener at jenkins-hbase9.apache.org/37221] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:53:43,431 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 10:53:43,441 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 10:53:43,942 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:53:43,944 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:53:44,118 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0001_000001 (auth:SIMPLE) 2023-07-12 10:53:45,133 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:53:49,478 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0001_000001 (auth:SIMPLE) 2023-07-12 10:53:51,724 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0001_000001 (auth:SIMPLE) 2023-07-12 10:53:55,560 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0001_000001 (auth:SIMPLE) 2023-07-12 10:53:57,373 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:53:57,378 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:53:57,389 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 10:53:57,390 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:53:57,390 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:53:57,391 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 10:53:57,391 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 10:53:57,392 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 10:53:57,392 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657/.hbase-snapshot/testExportWithTargetName 2023-07-12 10:53:57,392 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 10:53:57,392 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159221657/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 10:53:57,403 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 10:53:57,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-12 10:53:57,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,420 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159237420"}]},"ts":"1689159237420"} 2023-07-12 10:53:57,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 10:53:57,422 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 10:53:57,424 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 10:53:57,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ec107d91012c3404601499381bfce916, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dec82ae7408512f9689bb1f7d8e4a5bc, UNASSIGN}] 2023-07-12 10:53:57,429 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ec107d91012c3404601499381bfce916, UNASSIGN 2023-07-12 10:53:57,429 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dec82ae7408512f9689bb1f7d8e4a5bc, UNASSIGN 2023-07-12 10:53:57,430 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dec82ae7408512f9689bb1f7d8e4a5bc, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:57,430 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ec107d91012c3404601499381bfce916, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:57,430 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159237430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159237430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159237430"}]},"ts":"1689159237430"} 2023-07-12 10:53:57,430 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159237430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159237430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159237430"}]},"ts":"1689159237430"} 2023-07-12 10:53:57,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure dec82ae7408512f9689bb1f7d8e4a5bc, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:53:57,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure ec107d91012c3404601499381bfce916, server=jenkins-hbase9.apache.org,44589,1689159209836}] 2023-07-12 10:53:57,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 10:53:57,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ec107d91012c3404601499381bfce916 2023-07-12 10:53:57,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ec107d91012c3404601499381bfce916, disabling compactions & flushes 2023-07-12 10:53:57,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:57,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:57,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. after waiting 0 ms 2023-07-12 10:53:57,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:57,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:57,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing dec82ae7408512f9689bb1f7d8e4a5bc, disabling compactions & flushes 2023-07-12 10:53:57,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:57,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:57,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. after waiting 0 ms 2023-07-12 10:53:57,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:57,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:53:57,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:53:57,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:57,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:57,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc. 2023-07-12 10:53:57,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916. 2023-07-12 10:53:57,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ec107d91012c3404601499381bfce916: 2023-07-12 10:53:57,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for dec82ae7408512f9689bb1f7d8e4a5bc: 2023-07-12 10:53:57,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ec107d91012c3404601499381bfce916 2023-07-12 10:53:57,633 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ec107d91012c3404601499381bfce916, regionState=CLOSED 2023-07-12 10:53:57,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:57,633 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159237633"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159237633"}]},"ts":"1689159237633"} 2023-07-12 10:53:57,634 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dec82ae7408512f9689bb1f7d8e4a5bc, regionState=CLOSED 2023-07-12 10:53:57,635 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159237634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159237634"}]},"ts":"1689159237634"} 2023-07-12 10:53:57,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-12 10:53:57,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure ec107d91012c3404601499381bfce916, server=jenkins-hbase9.apache.org,44589,1689159209836 in 206 msec 2023-07-12 10:53:57,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-12 10:53:57,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure dec82ae7408512f9689bb1f7d8e4a5bc, server=jenkins-hbase9.apache.org,38185,1689159209730 in 209 msec 2023-07-12 10:53:57,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ec107d91012c3404601499381bfce916, UNASSIGN in 217 msec 2023-07-12 10:53:57,651 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-12 10:53:57,651 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=dec82ae7408512f9689bb1f7d8e4a5bc, UNASSIGN in 222 msec 2023-07-12 10:53:57,652 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159237652"}]},"ts":"1689159237652"} 2023-07-12 10:53:57,654 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 10:53:57,656 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 10:53:57,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 246 msec 2023-07-12 10:53:57,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 10:53:57,724 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 10:53:57,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-12 10:53:57,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,738 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 10:53:57,740 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,743 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 10:53:57,746 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,746 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,746 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,746 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916 2023-07-12 10:53:57,746 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,746 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:57,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 10:53:57,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 10:53:57,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 10:53:57,749 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,749 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,749 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:57,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 10:53:57,749 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,749 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:57,749 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:57,749 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:57,749 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 10:53:57,750 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/recovered.edits] 2023-07-12 10:53:57,750 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/recovered.edits] 2023-07-12 10:53:57,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 10:53:57,758 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/cf/8444b55bedde4bf182e8c310416b5377 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/cf/8444b55bedde4bf182e8c310416b5377 2023-07-12 10:53:57,758 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/cf/5ca7ddb3c06d4a5cb131a003ecda469c to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/cf/5ca7ddb3c06d4a5cb131a003ecda469c 2023-07-12 10:53:57,762 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916/recovered.edits/9.seqid 2023-07-12 10:53:57,762 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc/recovered.edits/9.seqid 2023-07-12 10:53:57,763 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/ec107d91012c3404601499381bfce916 2023-07-12 10:53:57,763 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportWithTargetName/dec82ae7408512f9689bb1f7d8e4a5bc 2023-07-12 10:53:57,763 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 10:53:57,766 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,785 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 10:53:57,788 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 10:53:57,789 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,789 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 10:53:57,790 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159237790"}]},"ts":"9223372036854775807"} 2023-07-12 10:53:57,790 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159237790"}]},"ts":"9223372036854775807"} 2023-07-12 10:53:57,792 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:53:57,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ec107d91012c3404601499381bfce916, NAME => 'testtb-testExportWithTargetName,,1689159219068.ec107d91012c3404601499381bfce916.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dec82ae7408512f9689bb1f7d8e4a5bc, NAME => 'testtb-testExportWithTargetName,1,1689159219068.dec82ae7408512f9689bb1f7d8e4a5bc.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:53:57,792 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 10:53:57,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159237792"}]},"ts":"9223372036854775807"} 2023-07-12 10:53:57,794 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 10:53:57,796 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 66 msec 2023-07-12 10:53:57,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 10:53:57,854 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 10:53:57,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 10:53:57,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:57,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 10:53:57,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 10:53:57,908 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=759 (was 708) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-140978657_1 at /127.0.0.1:59054 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:38467 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x45150b13-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:54174 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:39647 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-140978657_1 at /127.0.0.1:34076 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:37891 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:34096 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:59068 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=532 (was 385) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=6381 (was 8241) 2023-07-12 10:53:57,909 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-12 10:53:57,929 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=759, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=532, ProcessCount=178, AvailableMemoryMB=6380 2023-07-12 10:53:57,929 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-12 10:53:57,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:57,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:53:57,935 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:53:57,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 10:53:57,937 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:53:57,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 10:53:57,939 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa 2023-07-12 10:53:57,939 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c 2023-07-12 10:53:57,940 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa empty. 2023-07-12 10:53:57,940 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c empty. 2023-07-12 10:53:57,940 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa 2023-07-12 10:53:57,940 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c 2023-07-12 10:53:57,941 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 10:53:57,953 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:57,955 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d85797680abecf3ea00671ec07fab02c, NAME => 'testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:53:57,955 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c2204461ba10913cb85a6a2215456afa, NAME => 'testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:53:57,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:57,982 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c2204461ba10913cb85a6a2215456afa, disabling compactions & flushes 2023-07-12 10:53:57,982 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:57,982 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:57,982 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. after waiting 0 ms 2023-07-12 10:53:57,982 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:57,982 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:57,982 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c2204461ba10913cb85a6a2215456afa: 2023-07-12 10:53:57,982 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:57,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d85797680abecf3ea00671ec07fab02c, disabling compactions & flushes 2023-07-12 10:53:57,983 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:57,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:57,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. after waiting 0 ms 2023-07-12 10:53:57,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:57,983 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:57,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d85797680abecf3ea00671ec07fab02c: 2023-07-12 10:53:57,992 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:53:57,993 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159237993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159237993"}]},"ts":"1689159237993"} 2023-07-12 10:53:57,993 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159237993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159237993"}]},"ts":"1689159237993"} 2023-07-12 10:53:57,996 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:53:57,998 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:53:57,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159237998"}]},"ts":"1689159237998"} 2023-07-12 10:53:58,006 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 10:53:58,010 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:58,012 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:58,012 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:58,012 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:58,012 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:58,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2204461ba10913cb85a6a2215456afa, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d85797680abecf3ea00671ec07fab02c, ASSIGN}] 2023-07-12 10:53:58,015 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2204461ba10913cb85a6a2215456afa, ASSIGN 2023-07-12 10:53:58,015 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d85797680abecf3ea00671ec07fab02c, ASSIGN 2023-07-12 10:53:58,016 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2204461ba10913cb85a6a2215456afa, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38185,1689159209730; forceNewPlan=false, retain=false 2023-07-12 10:53:58,016 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d85797680abecf3ea00671ec07fab02c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44589,1689159209836; forceNewPlan=false, retain=false 2023-07-12 10:53:58,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 10:53:58,166 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:53:58,169 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c2204461ba10913cb85a6a2215456afa, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,169 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d85797680abecf3ea00671ec07fab02c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,169 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238169"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159238169"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159238169"}]},"ts":"1689159238169"} 2023-07-12 10:53:58,169 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238169"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159238169"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159238169"}]},"ts":"1689159238169"} 2023-07-12 10:53:58,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure c2204461ba10913cb85a6a2215456afa, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:53:58,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure d85797680abecf3ea00671ec07fab02c, server=jenkins-hbase9.apache.org,44589,1689159209836}] 2023-07-12 10:53:58,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 10:53:58,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:58,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2204461ba10913cb85a6a2215456afa, NAME => 'testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:53:58,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:58,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d85797680abecf3ea00671ec07fab02c, NAME => 'testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:53:58,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. service=AccessControlService 2023-07-12 10:53:58,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:58,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c2204461ba10913cb85a6a2215456afa 2023-07-12 10:53:58,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:58,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c2204461ba10913cb85a6a2215456afa 2023-07-12 10:53:58,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c2204461ba10913cb85a6a2215456afa 2023-07-12 10:53:58,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. service=AccessControlService 2023-07-12 10:53:58,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:58,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState d85797680abecf3ea00671ec07fab02c 2023-07-12 10:53:58,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:58,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d85797680abecf3ea00671ec07fab02c 2023-07-12 10:53:58,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d85797680abecf3ea00671ec07fab02c 2023-07-12 10:53:58,330 INFO [StoreOpener-c2204461ba10913cb85a6a2215456afa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c2204461ba10913cb85a6a2215456afa 2023-07-12 10:53:58,330 INFO [StoreOpener-d85797680abecf3ea00671ec07fab02c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d85797680abecf3ea00671ec07fab02c 2023-07-12 10:53:58,331 DEBUG [StoreOpener-c2204461ba10913cb85a6a2215456afa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/cf 2023-07-12 10:53:58,332 DEBUG [StoreOpener-c2204461ba10913cb85a6a2215456afa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/cf 2023-07-12 10:53:58,332 DEBUG [StoreOpener-d85797680abecf3ea00671ec07fab02c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/cf 2023-07-12 10:53:58,332 DEBUG [StoreOpener-d85797680abecf3ea00671ec07fab02c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/cf 2023-07-12 10:53:58,332 INFO [StoreOpener-c2204461ba10913cb85a6a2215456afa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2204461ba10913cb85a6a2215456afa columnFamilyName cf 2023-07-12 10:53:58,332 INFO [StoreOpener-d85797680abecf3ea00671ec07fab02c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d85797680abecf3ea00671ec07fab02c columnFamilyName cf 2023-07-12 10:53:58,333 INFO [StoreOpener-c2204461ba10913cb85a6a2215456afa-1] regionserver.HStore(310): Store=c2204461ba10913cb85a6a2215456afa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:58,334 INFO [StoreOpener-d85797680abecf3ea00671ec07fab02c-1] regionserver.HStore(310): Store=d85797680abecf3ea00671ec07fab02c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:58,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa 2023-07-12 10:53:58,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c 2023-07-12 10:53:58,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa 2023-07-12 10:53:58,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c 2023-07-12 10:53:58,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c2204461ba10913cb85a6a2215456afa 2023-07-12 10:53:58,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d85797680abecf3ea00671ec07fab02c 2023-07-12 10:53:58,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:58,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:58,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c2204461ba10913cb85a6a2215456afa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67415769, jitterRate=0.004573240876197815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:58,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c2204461ba10913cb85a6a2215456afa: 2023-07-12 10:53:58,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d85797680abecf3ea00671ec07fab02c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74780458, jitterRate=0.11431565880775452}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:58,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d85797680abecf3ea00671ec07fab02c: 2023-07-12 10:53:58,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c., pid=31, masterSystemTime=1689159238325 2023-07-12 10:53:58,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa., pid=30, masterSystemTime=1689159238324 2023-07-12 10:53:58,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:58,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:58,345 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c2204461ba10913cb85a6a2215456afa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,346 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238345"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159238345"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159238345"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159238345"}]},"ts":"1689159238345"} 2023-07-12 10:53:58,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:58,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:58,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d85797680abecf3ea00671ec07fab02c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,347 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238346"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159238346"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159238346"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159238346"}]},"ts":"1689159238346"} 2023-07-12 10:53:58,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-12 10:53:58,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure c2204461ba10913cb85a6a2215456afa, server=jenkins-hbase9.apache.org,38185,1689159209730 in 177 msec 2023-07-12 10:53:58,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-12 10:53:58,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure d85797680abecf3ea00671ec07fab02c, server=jenkins-hbase9.apache.org,44589,1689159209836 in 177 msec 2023-07-12 10:53:58,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2204461ba10913cb85a6a2215456afa, ASSIGN in 339 msec 2023-07-12 10:53:58,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-12 10:53:58,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d85797680abecf3ea00671ec07fab02c, ASSIGN in 341 msec 2023-07-12 10:53:58,356 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:53:58,356 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159238356"}]},"ts":"1689159238356"} 2023-07-12 10:53:58,357 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 10:53:58,359 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:53:58,360 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 10:53:58,361 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:53:58,363 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:58,363 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:58,363 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:58,363 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:58,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:58,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:58,366 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:58,366 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:58,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 433 msec 2023-07-12 10:53:58,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 10:53:58,541 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 10:53:58,541 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 10:53:58,541 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:58,546 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 10:53:58,546 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:58,546 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-12 10:53:58,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:58,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159238553 (current time:1689159238553). 2023-07-12 10:53:58,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:53:58,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x2116ae37 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:58,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@528283b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:58,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:58,567 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:58,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2116ae37 to 127.0.0.1:53956 2023-07-12 10:53:58,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:58,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x13e40f85 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:58,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7176cd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:58,578 DEBUG [hconnection-0x414eb0c1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:58,580 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:58,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13e40f85 to 127.0.0.1:53956 2023-07-12 10:53:58,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:58,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:53:58,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:53:58,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:58,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:53:58,592 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:53:58,593 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689159838593 2023-07-12 10:53:58,593 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 10:53:58,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:58,595 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:53:58,596 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:53:58,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:53:58,597 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:53:58,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-12 10:53:58,606 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:53:58,607 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689159838607 2023-07-12 10:53:58,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,640 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 10:53:58,641 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:58,642 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 10:53:58,642 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 10:53:58,643 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,643 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,644 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:58,644 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:58,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:58,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:58,645 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:58,645 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:58,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:58,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:58,645 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,645 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,646 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,646 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:53:58,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 10:53:58,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,647 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:53:58,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,647 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:53:58,647 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:58,648 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:53:58,648 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:53:58,648 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 10:53:58,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 10:53:58,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:53:58,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 10:53:58,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:53:58,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,650 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:53:58,650 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:58,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,650 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:53:58,651 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:58,651 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:53:58,652 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:53:58,652 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:53:58,652 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:53:58,652 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 10:53:58,652 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 10:53:58,653 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,654 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,654 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:58,661 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,662 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:58,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:58,662 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,663 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:58,663 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,663 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:58,663 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:58,663 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 10:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4888655e[Count = 1] remaining members to acquire global barrier 2023-07-12 10:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:58,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:58,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:58,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:58,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 10:53:58,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4888655e[Count = 0] remaining members to acquire global barrier 2023-07-12 10:53:58,674 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 10:53:58,675 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,676 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,676 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,676 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,676 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:53:58,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,676 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,676 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:53:58,677 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 10:53:58,677 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:53:58,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,677 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:53:58,677 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,677 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:53:58,679 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:53:58,679 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:58,679 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 10:53:58,687 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:58,687 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:58,687 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:58,687 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:58,687 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:58,688 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:58,688 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. started... 2023-07-12 10:53:58,688 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. started... 2023-07-12 10:53:58,691 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2204461ba10913cb85a6a2215456afa: 2023-07-12 10:53:58,691 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,691 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:58,691 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:53:58,692 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d85797680abecf3ea00671ec07fab02c: 2023-07-12 10:53:58,692 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,692 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:58,692 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:53:58,696 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:58,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:53:58,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:58,698 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:53:58,754 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. completed. 2023-07-12 10:53:58,754 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:58,754 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:58,754 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:58,754 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,765 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 10:53:58,766 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:53:58,768 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,768 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:53:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:58,768 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:58,768 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 10:53:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:58,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:58,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,780 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. completed. 2023-07-12 10:53:58,780 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:58,780 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:58,780 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:58,780 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,780 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 10:53:58,780 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:53:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,782 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:53:58,782 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:58,782 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,782 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 10:53:58,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:53:58,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 10:53:58,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:58,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:58,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,44589,1689159209836': 2023-07-12 10:53:58,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 10:53:58,795 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 10:53:58,795 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:53:58,795 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:53:58,795 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,795 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:53:58,797 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,797 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,797 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,797 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:58,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,797 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,797 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:58,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:58,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:58,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,797 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:58,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:58,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:58,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,798 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:58,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:58,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:58,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:58,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:58,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,799 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,799 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:58,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,801 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:58,803 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,803 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,809 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:58,809 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:58,809 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:58,809 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:58,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:58,809 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:58,809 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:58,809 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:58,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:58,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:58,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:58,809 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:58,811 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:58,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:58,811 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,812 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,812 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,812 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:58,812 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,812 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:58,812 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:58,812 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,812 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:58,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:58,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,889 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 10:53:58,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,889 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689159238593Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689159238811 (+218 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689159238811Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689159238819 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689159238843 (+24 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689159238889 (+46 ms) 2023-07-12 10:53:58,892 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:53:58,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 297 msec 2023-07-12 10:53:58,898 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:58,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:53:58,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:53:58,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38185] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:53:58,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44589] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:53:58,921 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 10:53:58,921 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:58,923 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:58,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:58,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159238936 (current time:1689159238936). 2023-07-12 10:53:58,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:53:58,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x22096817 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:58,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@206869b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:58,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:58,948 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:58,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22096817 to 127.0.0.1:53956 2023-07-12 10:53:58,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:58,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x723638c8 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:58,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78d06879, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:58,961 DEBUG [hconnection-0x70af23a7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:58,964 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:58,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x723638c8 to 127.0.0.1:53956 2023-07-12 10:53:58,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:58,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:53:58,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:53:58,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:58,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:53:58,975 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:53:58,977 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689159838977 2023-07-12 10:53:58,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:58,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 10:53:58,980 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:53:58,980 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:53:58,980 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:53:58,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:53:58,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-12 10:53:58,983 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:53:58,984 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689159838984 2023-07-12 10:53:59,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 10:53:59,001 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 10:53:59,001 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:59,002 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 10:53:59,002 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 10:53:59,003 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,003 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,005 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:59,005 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:59,005 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:59,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:59,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:59,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:59,005 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:59,006 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,006 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,007 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,007 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:53:59,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 10:53:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,007 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:53:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,008 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 10:53:59,008 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:53:59,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,008 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:59,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,009 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:53:59,009 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:53:59,009 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 10:53:59,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 10:53:59,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 10:53:59,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,010 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:53:59,010 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:53:59,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 10:53:59,010 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:53:59,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 10:53:59,010 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:59,010 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:53:59,011 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:53:59,011 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:53:59,011 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:59,011 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 10:53:59,012 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,012 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:53:59,012 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:53:59,012 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 10:53:59,012 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,012 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:59,014 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,014 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:59,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:59,014 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,014 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,014 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:59,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:59,014 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:59,015 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,015 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:53:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:59,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 10:53:59,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fd21dc4[Count = 1] remaining members to acquire global barrier 2023-07-12 10:53:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:59,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 10:53:59,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fd21dc4[Count = 0] remaining members to acquire global barrier 2023-07-12 10:53:59,019 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 10:53:59,019 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,021 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,021 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,021 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,022 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:53:59,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,022 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,022 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:59,022 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:53:59,022 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. started... 2023-07-12 10:53:59,022 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:59,022 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:53:59,022 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 10:53:59,022 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:53:59,022 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:59,022 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:59,022 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:59,022 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,022 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:53:59,022 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c2204461ba10913cb85a6a2215456afa 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 10:53:59,022 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:59,023 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. started... 2023-07-12 10:53:59,023 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d85797680abecf3ea00671ec07fab02c 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 10:53:59,024 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:53:59,024 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:59,024 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 10:53:59,038 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/.tmp/cf/0ae24a765a0241ed8cd697d7fe907c4e 2023-07-12 10:53:59,047 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/.tmp/cf/0ae24a765a0241ed8cd697d7fe907c4e as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/cf/0ae24a765a0241ed8cd697d7fe907c4e 2023-07-12 10:53:59,047 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/.tmp/cf/7705015767df45269f7709570ece0d8e 2023-07-12 10:53:59,056 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/cf/0ae24a765a0241ed8cd697d7fe907c4e, entries=2, sequenceid=6, filesize=5.0 K 2023-07-12 10:53:59,057 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/.tmp/cf/7705015767df45269f7709570ece0d8e as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/cf/7705015767df45269f7709570ece0d8e 2023-07-12 10:53:59,058 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c2204461ba10913cb85a6a2215456afa in 36ms, sequenceid=6, compaction requested=false 2023-07-12 10:53:59,058 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 10:53:59,059 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2204461ba10913cb85a6a2215456afa: 2023-07-12 10:53:59,059 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 10:53:59,059 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:59,059 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/cf/0ae24a765a0241ed8cd697d7fe907c4e] hfiles 2023-07-12 10:53:59,059 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/cf/0ae24a765a0241ed8cd697d7fe907c4e for snapshot=snaptb0-testExportFileSystemState 2023-07-12 10:53:59,064 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/cf/7705015767df45269f7709570ece0d8e, entries=48, sequenceid=6, filesize=8.1 K 2023-07-12 10:53:59,066 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d85797680abecf3ea00671ec07fab02c in 43ms, sequenceid=6, compaction requested=false 2023-07-12 10:53:59,068 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d85797680abecf3ea00671ec07fab02c: 2023-07-12 10:53:59,068 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 10:53:59,068 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:59,068 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/cf/7705015767df45269f7709570ece0d8e] hfiles 2023-07-12 10:53:59,068 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/cf/7705015767df45269f7709570ece0d8e for snapshot=snaptb0-testExportFileSystemState 2023-07-12 10:53:59,073 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. completed. 2023-07-12 10:53:59,074 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:53:59,074 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:59,074 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:59,074 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,074 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 10:53:59,074 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:53:59,078 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:53:59,078 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,078 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:59,078 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 10:53:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:59,081 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:53:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:53:59,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:59,082 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:53:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:59,083 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. completed. 2023-07-12 10:53:59,083 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:53:59,084 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:59,084 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:59,084 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,084 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 10:53:59,084 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:53:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:53:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,085 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:53:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,085 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,085 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:59,085 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 10:53:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:53:59,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 10:53:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:53:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:53:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,44589,1689159209836': 2023-07-12 10:53:59,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 10:53:59,091 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 10:53:59,091 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:53:59,091 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:53:59,091 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 10:53:59,091 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:53:59,093 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,093 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:59,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,093 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,093 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,093 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,094 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:59,094 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,094 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:53:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,095 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:59,095 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:53:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,097 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:59,097 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:53:59,098 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,102 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:59,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:59,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:59,102 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:59,102 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:59,102 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:59,102 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:59,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:59,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,102 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:59,103 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,103 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,103 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,104 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,104 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 10:53:59,104 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:53:59,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 10:53:59,104 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:59,104 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,104 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:53:59,104 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:53:59,104 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,104 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 10:53:59,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,171 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689159238977Consolidate snapshot: snaptb0-testExportFileSystemState at 1689159239104 (+127 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689159239104Writing data manifest for snaptb0-testExportFileSystemState at 1689159239114 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689159239128 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689159239170 (+42 ms) 2023-07-12 10:53:59,174 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:53:59,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 196 msec 2023-07-12 10:53:59,282 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:59,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:53:59,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:53:59,285 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285 2023-07-12 10:53:59,286 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37511, tgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285, rawTgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285, srcFsUri=hdfs://localhost:37511, srcDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:53:59,316 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:53:59,316 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1829545120_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,316 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7, snapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 10:53:59,329 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:53:59,362 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,363 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,363 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,364 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,364 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,364 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,365 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,438 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop-2067300931977039724.jar 2023-07-12 10:53:59,439 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,439 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,440 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,440 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,441 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,441 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:59,442 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:53:59,443 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:53:59,443 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:53:59,444 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:53:59,444 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:53:59,445 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:53:59,446 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:53:59,446 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:53:59,447 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:53:59,447 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:53:59,448 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:59,449 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:59,449 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:53:59,450 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:59,450 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:59,451 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:53:59,451 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:53:59,869 WARN [Listener at jenkins-hbase9.apache.org/37221] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:53:59,871 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 10:53:59,874 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 10:54:01,766 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:01,770 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:01,776 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0001_000001 (auth:SIMPLE) 2023-07-12 10:54:02,508 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:03,235 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:54:07,274 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:09,505 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:12,434 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:14,094 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:54:14,095 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:54:14,106 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 10:54:14,106 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:54:14,106 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:54:14,107 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 10:54:14,107 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 10:54:14,107 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 10:54:14,107 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 10:54:14,108 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 10:54:14,108 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159239285/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 10:54:14,116 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 10:54:14,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-12 10:54:14,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 10:54:14,123 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159254123"}]},"ts":"1689159254123"} 2023-07-12 10:54:14,125 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 10:54:14,132 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 10:54:14,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2204461ba10913cb85a6a2215456afa, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d85797680abecf3ea00671ec07fab02c, UNASSIGN}] 2023-07-12 10:54:14,135 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2204461ba10913cb85a6a2215456afa, UNASSIGN 2023-07-12 10:54:14,135 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d85797680abecf3ea00671ec07fab02c, UNASSIGN 2023-07-12 10:54:14,136 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c2204461ba10913cb85a6a2215456afa, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:14,136 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d85797680abecf3ea00671ec07fab02c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:14,136 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159254136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159254136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159254136"}]},"ts":"1689159254136"} 2023-07-12 10:54:14,136 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159254136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159254136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159254136"}]},"ts":"1689159254136"} 2023-07-12 10:54:14,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure c2204461ba10913cb85a6a2215456afa, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:54:14,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure d85797680abecf3ea00671ec07fab02c, server=jenkins-hbase9.apache.org,44589,1689159209836}] 2023-07-12 10:54:14,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 10:54:14,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d85797680abecf3ea00671ec07fab02c 2023-07-12 10:54:14,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d85797680abecf3ea00671ec07fab02c, disabling compactions & flushes 2023-07-12 10:54:14,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:54:14,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:54:14,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. after waiting 0 ms 2023-07-12 10:54:14,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:54:14,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close c2204461ba10913cb85a6a2215456afa 2023-07-12 10:54:14,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c2204461ba10913cb85a6a2215456afa, disabling compactions & flushes 2023-07-12 10:54:14,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:54:14,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:54:14,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. after waiting 0 ms 2023-07-12 10:54:14,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:54:14,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:54:14,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:14,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c. 2023-07-12 10:54:14,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d85797680abecf3ea00671ec07fab02c: 2023-07-12 10:54:14,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:54:14,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:14,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa. 2023-07-12 10:54:14,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c2204461ba10913cb85a6a2215456afa: 2023-07-12 10:54:14,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d85797680abecf3ea00671ec07fab02c 2023-07-12 10:54:14,315 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d85797680abecf3ea00671ec07fab02c, regionState=CLOSED 2023-07-12 10:54:14,315 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159254315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159254315"}]},"ts":"1689159254315"} 2023-07-12 10:54:14,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed c2204461ba10913cb85a6a2215456afa 2023-07-12 10:54:14,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c2204461ba10913cb85a6a2215456afa, regionState=CLOSED 2023-07-12 10:54:14,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159254316"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159254316"}]},"ts":"1689159254316"} 2023-07-12 10:54:14,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-12 10:54:14,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure d85797680abecf3ea00671ec07fab02c, server=jenkins-hbase9.apache.org,44589,1689159209836 in 177 msec 2023-07-12 10:54:14,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-12 10:54:14,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure c2204461ba10913cb85a6a2215456afa, server=jenkins-hbase9.apache.org,38185,1689159209730 in 179 msec 2023-07-12 10:54:14,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d85797680abecf3ea00671ec07fab02c, UNASSIGN in 187 msec 2023-07-12 10:54:14,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-12 10:54:14,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c2204461ba10913cb85a6a2215456afa, UNASSIGN in 188 msec 2023-07-12 10:54:14,324 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159254324"}]},"ts":"1689159254324"} 2023-07-12 10:54:14,325 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 10:54:14,327 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 10:54:14,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 211 msec 2023-07-12 10:54:14,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 10:54:14,425 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 10:54:14,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-12 10:54:14,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,430 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 10:54:14,431 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,434 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 10:54:14,436 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,436 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,436 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,437 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 10:54:14,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 10:54:14,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 10:54:14,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 10:54:14,438 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa 2023-07-12 10:54:14,438 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c 2023-07-12 10:54:14,439 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,439 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,439 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,440 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:14,440 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:14,439 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:14,439 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,440 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:14,440 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/recovered.edits] 2023-07-12 10:54:14,440 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/recovered.edits] 2023-07-12 10:54:14,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 10:54:14,445 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/cf/7705015767df45269f7709570ece0d8e to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/cf/7705015767df45269f7709570ece0d8e 2023-07-12 10:54:14,445 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/cf/0ae24a765a0241ed8cd697d7fe907c4e to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/cf/0ae24a765a0241ed8cd697d7fe907c4e 2023-07-12 10:54:14,449 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa/recovered.edits/9.seqid 2023-07-12 10:54:14,449 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c/recovered.edits/9.seqid 2023-07-12 10:54:14,450 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/c2204461ba10913cb85a6a2215456afa 2023-07-12 10:54:14,450 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemState/d85797680abecf3ea00671ec07fab02c 2023-07-12 10:54:14,450 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 10:54:14,452 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,454 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 10:54:14,456 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 10:54:14,458 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,458 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 10:54:14,458 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159254458"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:14,458 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159254458"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:14,460 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:54:14,460 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c2204461ba10913cb85a6a2215456afa, NAME => 'testtb-testExportFileSystemState,,1689159237930.c2204461ba10913cb85a6a2215456afa.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d85797680abecf3ea00671ec07fab02c, NAME => 'testtb-testExportFileSystemState,1,1689159237930.d85797680abecf3ea00671ec07fab02c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:54:14,460 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 10:54:14,460 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159254460"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:14,462 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 10:54:14,463 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 37 msec 2023-07-12 10:54:14,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 10:54:14,542 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 10:54:14,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 10:54:14,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 10:54:14,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 10:54:14,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 10:54:14,579 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 759) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2069 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x45150b13-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:51490 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:39658 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_792735998_17 at /127.0.0.1:56122 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:34951 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1447023363_1 at /127.0.0.1:51462 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=466 (was 532), ProcessCount=178 (was 178), AvailableMemoryMB=6157 (was 6380) 2023-07-12 10:54:14,580 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-12 10:54:14,600 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=466, ProcessCount=178, AvailableMemoryMB=6157 2023-07-12 10:54:14,600 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-12 10:54:14,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:54:14,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:14,606 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:54:14,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 10:54:14,608 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:54:14,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 10:54:14,611 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:14,611 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4 empty. 2023-07-12 10:54:14,611 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:14,612 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:14,612 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7 empty. 2023-07-12 10:54:14,613 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:14,613 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 10:54:14,634 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 10:54:14,636 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6e57edcd87a8a18bdbd2ba5601bf07b4, NAME => 'testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:54:14,636 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => dc889198e1c316c5035f6d98a2b830e7, NAME => 'testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:54:14,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:14,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing dc889198e1c316c5035f6d98a2b830e7, disabling compactions & flushes 2023-07-12 10:54:14,669 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:14,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:14,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. after waiting 0 ms 2023-07-12 10:54:14,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:14,669 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:14,669 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for dc889198e1c316c5035f6d98a2b830e7: 2023-07-12 10:54:14,671 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:14,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 6e57edcd87a8a18bdbd2ba5601bf07b4, disabling compactions & flushes 2023-07-12 10:54:14,672 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:14,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:14,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. after waiting 0 ms 2023-07-12 10:54:14,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:14,672 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:14,672 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 6e57edcd87a8a18bdbd2ba5601bf07b4: 2023-07-12 10:54:14,675 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:54:14,676 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159254676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159254676"}]},"ts":"1689159254676"} 2023-07-12 10:54:14,676 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159254676"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159254676"}]},"ts":"1689159254676"} 2023-07-12 10:54:14,679 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:54:14,680 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:54:14,680 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159254680"}]},"ts":"1689159254680"} 2023-07-12 10:54:14,681 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 10:54:14,684 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:54:14,685 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:54:14,685 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:54:14,685 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:54:14,685 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:54:14,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6e57edcd87a8a18bdbd2ba5601bf07b4, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc889198e1c316c5035f6d98a2b830e7, ASSIGN}] 2023-07-12 10:54:14,688 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc889198e1c316c5035f6d98a2b830e7, ASSIGN 2023-07-12 10:54:14,689 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6e57edcd87a8a18bdbd2ba5601bf07b4, ASSIGN 2023-07-12 10:54:14,690 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc889198e1c316c5035f6d98a2b830e7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35663,1689159209791; forceNewPlan=false, retain=false 2023-07-12 10:54:14,690 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6e57edcd87a8a18bdbd2ba5601bf07b4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38185,1689159209730; forceNewPlan=false, retain=false 2023-07-12 10:54:14,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 10:54:14,840 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:54:14,843 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=dc889198e1c316c5035f6d98a2b830e7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:14,843 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6e57edcd87a8a18bdbd2ba5601bf07b4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:14,843 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159254843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159254843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159254843"}]},"ts":"1689159254843"} 2023-07-12 10:54:14,843 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159254843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159254843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159254843"}]},"ts":"1689159254843"} 2023-07-12 10:54:14,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure dc889198e1c316c5035f6d98a2b830e7, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:54:14,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 6e57edcd87a8a18bdbd2ba5601bf07b4, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:54:14,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 10:54:15,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:15,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:15,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6e57edcd87a8a18bdbd2ba5601bf07b4, NAME => 'testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:54:15,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc889198e1c316c5035f6d98a2b830e7, NAME => 'testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:54:15,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. service=AccessControlService 2023-07-12 10:54:15,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. service=AccessControlService 2023-07-12 10:54:15,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:15,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:15,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:15,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:15,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:15,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:15,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:15,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:15,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:15,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:15,010 INFO [StoreOpener-dc889198e1c316c5035f6d98a2b830e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:15,010 INFO [StoreOpener-6e57edcd87a8a18bdbd2ba5601bf07b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:15,012 DEBUG [StoreOpener-dc889198e1c316c5035f6d98a2b830e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/cf 2023-07-12 10:54:15,012 DEBUG [StoreOpener-dc889198e1c316c5035f6d98a2b830e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/cf 2023-07-12 10:54:15,012 DEBUG [StoreOpener-6e57edcd87a8a18bdbd2ba5601bf07b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/cf 2023-07-12 10:54:15,012 DEBUG [StoreOpener-6e57edcd87a8a18bdbd2ba5601bf07b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/cf 2023-07-12 10:54:15,012 INFO [StoreOpener-dc889198e1c316c5035f6d98a2b830e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc889198e1c316c5035f6d98a2b830e7 columnFamilyName cf 2023-07-12 10:54:15,013 INFO [StoreOpener-6e57edcd87a8a18bdbd2ba5601bf07b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e57edcd87a8a18bdbd2ba5601bf07b4 columnFamilyName cf 2023-07-12 10:54:15,013 INFO [StoreOpener-dc889198e1c316c5035f6d98a2b830e7-1] regionserver.HStore(310): Store=dc889198e1c316c5035f6d98a2b830e7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:15,014 INFO [StoreOpener-6e57edcd87a8a18bdbd2ba5601bf07b4-1] regionserver.HStore(310): Store=6e57edcd87a8a18bdbd2ba5601bf07b4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:15,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:15,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:15,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:15,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:15,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:15,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:15,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:15,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:15,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6e57edcd87a8a18bdbd2ba5601bf07b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59198130, jitterRate=-0.11787912249565125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:15,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6e57edcd87a8a18bdbd2ba5601bf07b4: 2023-07-12 10:54:15,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened dc889198e1c316c5035f6d98a2b830e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70221111, jitterRate=0.04637609422206879}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:15,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for dc889198e1c316c5035f6d98a2b830e7: 2023-07-12 10:54:15,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4., pid=46, masterSystemTime=1689159254998 2023-07-12 10:54:15,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7., pid=45, masterSystemTime=1689159254997 2023-07-12 10:54:15,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:15,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:15,023 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6e57edcd87a8a18bdbd2ba5601bf07b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,023 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159255023"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159255023"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159255023"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159255023"}]},"ts":"1689159255023"} 2023-07-12 10:54:15,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:15,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:15,024 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=dc889198e1c316c5035f6d98a2b830e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,024 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159255024"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159255024"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159255024"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159255024"}]},"ts":"1689159255024"} 2023-07-12 10:54:15,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-12 10:54:15,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 6e57edcd87a8a18bdbd2ba5601bf07b4, server=jenkins-hbase9.apache.org,38185,1689159209730 in 179 msec 2023-07-12 10:54:15,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-12 10:54:15,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure dc889198e1c316c5035f6d98a2b830e7, server=jenkins-hbase9.apache.org,35663,1689159209791 in 181 msec 2023-07-12 10:54:15,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6e57edcd87a8a18bdbd2ba5601bf07b4, ASSIGN in 344 msec 2023-07-12 10:54:15,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-12 10:54:15,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc889198e1c316c5035f6d98a2b830e7, ASSIGN in 344 msec 2023-07-12 10:54:15,033 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:54:15,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159255033"}]},"ts":"1689159255033"} 2023-07-12 10:54:15,034 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 10:54:15,036 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:54:15,037 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 10:54:15,038 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 10:54:15,040 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:15,040 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:15,040 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:15,040 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:15,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:15,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:15,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:15,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:15,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 441 msec 2023-07-12 10:54:15,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 10:54:15,213 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 10:54:15,213 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-12 10:54:15,213 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:15,217 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-12 10:54:15,217 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:15,217 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-12 10:54:15,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:15,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159255221 (current time:1689159255221). 2023-07-12 10:54:15,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:15,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x3cf12e10 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:15,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dde2ee1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:15,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:15,230 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:15,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cf12e10 to 127.0.0.1:53956 2023-07-12 10:54:15,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:15,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x4f94b01e to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:15,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aa09652, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:15,240 DEBUG [hconnection-0x26d506c1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:15,243 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:15,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f94b01e to 127.0.0.1:53956 2023-07-12 10:54:15,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:15,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 10:54:15,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:15,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:15,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:15,254 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:15,254 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689159855254 2023-07-12 10:54:15,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:15,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 10:54:15,256 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:15,256 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:15,257 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:15,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:15,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-12 10:54:15,259 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:15,260 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689159855260 2023-07-12 10:54:15,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,279 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 10:54:15,279 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,280 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 10:54:15,280 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 10:54:15,281 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,281 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,282 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,283 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,283 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,284 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,284 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,285 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,285 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,285 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,285 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,285 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:15,285 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,289 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:15,289 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:15,290 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:15,289 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:15,289 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:15,290 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:15,290 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:15,290 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:15,290 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:15,291 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,291 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,292 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,293 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,294 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,293 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,294 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:15,294 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,294 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,294 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,294 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 10:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47d2b094[Count = 1] remaining members to acquire global barrier 2023-07-12 10:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 10:54:15,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47d2b094[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:15,299 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 10:54:15,299 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:15,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,300 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:15,301 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:15,301 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:15,301 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,301 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:15,301 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:15,301 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. started... 2023-07-12 10:54:15,301 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:15,301 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:15,301 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:15,301 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:15,303 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc889198e1c316c5035f6d98a2b830e7: 2023-07-12 10:54:15,301 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,303 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:15,301 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. started... 2023-07-12 10:54:15,303 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:54:15,303 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,304 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e57edcd87a8a18bdbd2ba5601bf07b4: 2023-07-12 10:54:15,305 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:15,305 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:54:15,305 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,306 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:15,306 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:54:15,314 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:15,314 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:15,314 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:15,342 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. completed. 2023-07-12 10:54:15,342 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:15,342 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:15,343 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:15,343 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,343 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:15,343 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:54:15,345 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:15,345 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,345 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:15,345 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:15,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,35663,1689159209791': 2023-07-12 10:54:15,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 10:54:15,351 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. completed. 2023-07-12 10:54:15,351 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:15,352 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:15,352 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:15,352 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,352 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:15,352 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:54:15,353 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,353 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:15,353 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:15,353 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,356 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:15,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:15,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:15,357 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:54:15,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 10:54:15,362 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 10:54:15,362 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:15,362 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:15,362 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,362 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:15,365 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,365 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,365 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,367 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,367 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,370 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,370 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,371 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,375 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,375 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,375 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:15,375 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,375 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,377 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,377 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,377 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,378 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,558 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:15,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:15,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:15,559 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:54:15,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 10:54:15,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,852 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689159255255Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689159255377 (+122 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689159255377Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689159255381 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689159255398 (+17 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689159255851 (+453 ms) 2023-07-12 10:54:15,858 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:15,859 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:15,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 603 msec 2023-07-12 10:54:15,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:15,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:15,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38185] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:54:15,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35663] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:54:15,876 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 10:54:15,876 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:15,876 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:15,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:15,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159255889 (current time:1689159255889). 2023-07-12 10:54:15,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:15,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x3914bd82 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:15,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@624f5785, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:15,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:15,909 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:15,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3914bd82 to 127.0.0.1:53956 2023-07-12 10:54:15,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:15,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x03d9b3f1 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:15,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fbde6a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:15,930 DEBUG [hconnection-0x7d679a8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:15,931 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:15,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03d9b3f1 to 127.0.0.1:53956 2023-07-12 10:54:15,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:15,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 10:54:15,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:15,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:15,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:15,942 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:15,943 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689159855943 2023-07-12 10:54:15,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 10:54:15,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:15,944 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:15,945 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:15,946 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:15,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:15,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-12 10:54:15,948 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:15,950 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689159855950 2023-07-12 10:54:15,961 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 10:54:15,961 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 10:54:15,961 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,963 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 10:54:15,963 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 10:54:15,963 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,963 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,965 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,965 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,965 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,965 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,965 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,965 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,966 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,966 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:15,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 10:54:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 10:54:15,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 10:54:15,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:15,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:15,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 10:54:15,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 10:54:15,967 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:15,967 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:15,967 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,967 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,969 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:15,970 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:15,970 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:15,969 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:15,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 10:54:15,970 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:15,970 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:15,970 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,970 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:15,979 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:15,979 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:15,979 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:15,979 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:15,980 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,980 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,981 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,982 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,982 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,982 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,982 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:15,982 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,982 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:15,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,982 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,983 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:15,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:15,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 10:54:15,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f435036[Count = 1] remaining members to acquire global barrier 2023-07-12 10:54:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 10:54:15,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f435036[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:15,987 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 10:54:15,987 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:15,989 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:15,989 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:15,989 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:15,989 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:54:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:15,989 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:15,989 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:15,990 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:15,989 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. started... 2023-07-12 10:54:15,989 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:15,990 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:15,990 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:15,990 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dc889198e1c316c5035f6d98a2b830e7 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 10:54:15,990 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:15,990 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:15,990 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:15,990 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. started... 2023-07-12 10:54:15,990 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6e57edcd87a8a18bdbd2ba5601bf07b4 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 10:54:15,991 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:15,991 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:15,991 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:16,017 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/.tmp/cf/bc1853f4bedd420e989f8e2f585121b1 2023-07-12 10:54:16,018 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/.tmp/cf/95f2ed3ec4964480a1dc513503a0aa9b 2023-07-12 10:54:16,024 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/.tmp/cf/bc1853f4bedd420e989f8e2f585121b1 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/cf/bc1853f4bedd420e989f8e2f585121b1 2023-07-12 10:54:16,024 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/.tmp/cf/95f2ed3ec4964480a1dc513503a0aa9b as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/cf/95f2ed3ec4964480a1dc513503a0aa9b 2023-07-12 10:54:16,029 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/cf/bc1853f4bedd420e989f8e2f585121b1, entries=46, sequenceid=6, filesize=7.9 K 2023-07-12 10:54:16,030 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/cf/95f2ed3ec4964480a1dc513503a0aa9b, entries=4, sequenceid=6, filesize=5.1 K 2023-07-12 10:54:16,030 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for dc889198e1c316c5035f6d98a2b830e7 in 40ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:16,030 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 6e57edcd87a8a18bdbd2ba5601bf07b4 in 40ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:16,031 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 10:54:16,031 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 10:54:16,032 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc889198e1c316c5035f6d98a2b830e7: 2023-07-12 10:54:16,032 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e57edcd87a8a18bdbd2ba5601bf07b4: 2023-07-12 10:54:16,032 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 10:54:16,033 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 10:54:16,033 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:16,033 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:16,033 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/cf/bc1853f4bedd420e989f8e2f585121b1] hfiles 2023-07-12 10:54:16,033 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/cf/95f2ed3ec4964480a1dc513503a0aa9b] hfiles 2023-07-12 10:54:16,033 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/cf/bc1853f4bedd420e989f8e2f585121b1 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 10:54:16,033 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/cf/95f2ed3ec4964480a1dc513503a0aa9b for snapshot=snaptb0-testConsecutiveExports 2023-07-12 10:54:16,045 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:16,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:16,046 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. completed. 2023-07-12 10:54:16,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:16,046 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:16,047 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:16,047 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:16,047 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,047 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:16,047 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:16,047 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:54:16,048 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. completed. 2023-07-12 10:54:16,048 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:16,048 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:16,048 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:16,048 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,048 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:16,048 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:54:16,049 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:16,049 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,049 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:16,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:16,049 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:16,052 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:16,052 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:16,053 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:16,053 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:16,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:16,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:16,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,35663,1689159209791': 2023-07-12 10:54:16,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 10:54:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:16,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:54:16,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 10:54:16,060 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 10:54:16,060 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:16,060 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:16,060 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 10:54:16,060 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:16,061 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:16,062 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,062 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,062 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,062 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,063 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,064 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:16,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:16,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,067 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,067 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,068 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,075 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:16,075 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:16,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:16,075 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:16,075 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:16,075 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,075 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:16,075 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:16,075 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,075 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 10:54:16,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 10:54:16,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,075 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,077 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,077 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:16,078 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,078 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:16,078 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:16,078 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,078 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,075 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:16,078 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:16,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:16,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,134 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 10:54:16,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,134 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689159255943Consolidate snapshot: snaptb0-testConsecutiveExports at 1689159256077 (+134 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689159256077Writing data manifest for snaptb0-testConsecutiveExports at 1689159256081 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689159256098 (+17 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689159256134 (+36 ms) 2023-07-12 10:54:16,137 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:16,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 193 msec 2023-07-12 10:54:16,247 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:16,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:16,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:16,248 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248 2023-07-12 10:54:16,248 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248, srcFsUri=hdfs://localhost:37511, srcDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:54:16,271 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:54:16,271 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@15a50b83, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,271 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7, snapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 10:54:16,278 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,290 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,290 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,290 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,291 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,291 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,291 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,292 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,360 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop-2029798249829187171.jar 2023-07-12 10:54:16,361 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,361 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,361 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,362 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,362 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,362 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,363 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:54:16,363 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:54:16,363 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:54:16,364 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:54:16,364 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:54:16,364 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:54:16,365 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:54:16,365 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:54:16,365 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:54:16,366 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:54:16,366 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:16,367 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:16,367 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:16,367 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:16,367 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:16,368 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:16,368 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:17,237 WARN [Listener at jenkins-hbase9.apache.org/37221] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:54:17,239 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 10:54:17,241 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 10:54:18,609 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:18,609 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:18,612 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:18,775 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0003_000001 (auth:SIMPLE) 2023-07-12 10:54:19,910 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:54:23,096 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0003_000001 (auth:SIMPLE) 2023-07-12 10:54:25,322 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0003_000001 (auth:SIMPLE) 2023-07-12 10:54:29,014 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0003_000001 (auth:SIMPLE) 2023-07-12 10:54:30,456 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:54:30,456 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:54:30,459 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 10:54:30,460 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:54:30,460 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:54:30,460 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:30,463 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 10:54:30,463 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 10:54:30,463 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@38ca574f in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:30,463 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 10:54:30,463 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 10:54:30,464 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248, srcFsUri=hdfs://localhost:37511, srcDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:54:30,486 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:54:30,486 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@12e6bf83, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:30,486 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7, snapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 10:54:30,497 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:30,509 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,510 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,510 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,510 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,511 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,511 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,511 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,578 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop-243886565837287862.jar 2023-07-12 10:54:30,579 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,579 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,579 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,580 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,580 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,580 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:30,581 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:54:30,581 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:54:30,582 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:54:30,582 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:54:30,582 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:54:30,583 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:54:30,583 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:54:30,583 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:54:30,584 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:54:30,584 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:54:30,584 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:30,585 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:30,585 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:30,585 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:30,586 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:30,586 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:30,586 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:30,954 WARN [Listener at jenkins-hbase9.apache.org/37221] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:54:30,956 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 10:54:30,958 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 10:54:35,195 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:35,196 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:35,198 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0003_000001 (auth:SIMPLE) 2023-07-12 10:54:35,526 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:39,848 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:42,075 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:45,370 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:47,196 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:54:47,196 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:54:47,200 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 10:54:47,200 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:54:47,200 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:54:47,200 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:47,205 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 10:54:47,205 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 10:54:47,205 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@38ca574f in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:47,205 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 10:54:47,205 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/local-export-1689159256248/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 10:54:47,219 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 10:54:47,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-12 10:54:47,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:47,225 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159287225"}]},"ts":"1689159287225"} 2023-07-12 10:54:47,227 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 10:54:47,228 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 10:54:47,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6e57edcd87a8a18bdbd2ba5601bf07b4, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc889198e1c316c5035f6d98a2b830e7, UNASSIGN}] 2023-07-12 10:54:47,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 10:54:47,235 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc889198e1c316c5035f6d98a2b830e7, UNASSIGN 2023-07-12 10:54:47,237 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6e57edcd87a8a18bdbd2ba5601bf07b4, UNASSIGN 2023-07-12 10:54:47,241 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6e57edcd87a8a18bdbd2ba5601bf07b4, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:47,241 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159287241"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159287241"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159287241"}]},"ts":"1689159287241"} 2023-07-12 10:54:47,242 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=dc889198e1c316c5035f6d98a2b830e7, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:47,242 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159287242"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159287242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159287242"}]},"ts":"1689159287242"} 2023-07-12 10:54:47,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 6e57edcd87a8a18bdbd2ba5601bf07b4, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:54:47,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure dc889198e1c316c5035f6d98a2b830e7, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:54:47,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 10:54:47,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:47,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 6e57edcd87a8a18bdbd2ba5601bf07b4, disabling compactions & flushes 2023-07-12 10:54:47,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:47,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:47,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing dc889198e1c316c5035f6d98a2b830e7, disabling compactions & flushes 2023-07-12 10:54:47,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:47,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:47,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. after waiting 0 ms 2023-07-12 10:54:47,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:47,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:47,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. after waiting 0 ms 2023-07-12 10:54:47,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:47,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:54:47,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:47,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:54:47,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4. 2023-07-12 10:54:47,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 6e57edcd87a8a18bdbd2ba5601bf07b4: 2023-07-12 10:54:47,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:47,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7. 2023-07-12 10:54:47,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for dc889198e1c316c5035f6d98a2b830e7: 2023-07-12 10:54:47,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:47,432 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6e57edcd87a8a18bdbd2ba5601bf07b4, regionState=CLOSED 2023-07-12 10:54:47,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:47,432 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159287432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159287432"}]},"ts":"1689159287432"} 2023-07-12 10:54:47,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=dc889198e1c316c5035f6d98a2b830e7, regionState=CLOSED 2023-07-12 10:54:47,433 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159287432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159287432"}]},"ts":"1689159287432"} 2023-07-12 10:54:47,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-12 10:54:47,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 6e57edcd87a8a18bdbd2ba5601bf07b4, server=jenkins-hbase9.apache.org,38185,1689159209730 in 191 msec 2023-07-12 10:54:47,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-12 10:54:47,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure dc889198e1c316c5035f6d98a2b830e7, server=jenkins-hbase9.apache.org,35663,1689159209791 in 191 msec 2023-07-12 10:54:47,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6e57edcd87a8a18bdbd2ba5601bf07b4, UNASSIGN in 207 msec 2023-07-12 10:54:47,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-12 10:54:47,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dc889198e1c316c5035f6d98a2b830e7, UNASSIGN in 208 msec 2023-07-12 10:54:47,443 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159287443"}]},"ts":"1689159287443"} 2023-07-12 10:54:47,444 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 10:54:47,446 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 10:54:47,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 227 msec 2023-07-12 10:54:47,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 10:54:47,535 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 10:54:47,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-12 10:54:47,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:47,540 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:47,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 10:54:47,542 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:47,546 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 10:54:47,551 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:47,551 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:47,551 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:47,552 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:47,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 10:54:47,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 10:54:47,552 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 10:54:47,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 10:54:47,553 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:47,554 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:47,554 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:47,554 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:47,554 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:47,555 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:47,555 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:47,555 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:47,555 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:47,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 10:54:47,558 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:47,562 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/recovered.edits] 2023-07-12 10:54:47,570 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/recovered.edits] 2023-07-12 10:54:47,587 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/cf/bc1853f4bedd420e989f8e2f585121b1 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/cf/bc1853f4bedd420e989f8e2f585121b1 2023-07-12 10:54:47,587 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/cf/95f2ed3ec4964480a1dc513503a0aa9b to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/cf/95f2ed3ec4964480a1dc513503a0aa9b 2023-07-12 10:54:47,592 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7/recovered.edits/9.seqid 2023-07-12 10:54:47,593 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4/recovered.edits/9.seqid 2023-07-12 10:54:47,593 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/dc889198e1c316c5035f6d98a2b830e7 2023-07-12 10:54:47,593 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testConsecutiveExports/6e57edcd87a8a18bdbd2ba5601bf07b4 2023-07-12 10:54:47,594 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 10:54:47,597 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:47,600 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 10:54:47,602 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 10:54:47,606 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:47,606 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 10:54:47,606 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159287606"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:47,606 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159287606"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:47,608 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:54:47,608 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6e57edcd87a8a18bdbd2ba5601bf07b4, NAME => 'testtb-testConsecutiveExports,,1689159254602.6e57edcd87a8a18bdbd2ba5601bf07b4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dc889198e1c316c5035f6d98a2b830e7, NAME => 'testtb-testConsecutiveExports,1,1689159254602.dc889198e1c316c5035f6d98a2b830e7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:54:47,608 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 10:54:47,608 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159287608"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:47,610 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 10:54:47,614 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:47,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 77 msec 2023-07-12 10:54:47,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 10:54:47,657 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 10:54:47,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 10:54:47,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:47,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 10:54:47,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 10:54:47,698 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=751 (was 765), OpenFileDescriptor=906 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 466), ProcessCount=180 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=6622 (was 6157) - AvailableMemoryMB LEAK? - 2023-07-12 10:54:47,699 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 10:54:47,723 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=180, AvailableMemoryMB=6616 2023-07-12 10:54:47,723 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 10:54:47,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:54:47,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:47,730 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:54:47,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 10:54:47,731 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:54:47,733 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:54:47,733 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:54:47,734 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9 empty. 2023-07-12 10:54:47,734 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a empty. 2023-07-12 10:54:47,734 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:54:47,735 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:54:47,735 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 10:54:47,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 10:54:47,769 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 10:54:47,771 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => c2ed7014e8bd1f931be541a50400f5b9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:54:47,771 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 34a5cb6595a97a0c97a10898a06c423a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:54:47,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:47,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing c2ed7014e8bd1f931be541a50400f5b9, disabling compactions & flushes 2023-07-12 10:54:47,800 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:47,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:47,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. after waiting 0 ms 2023-07-12 10:54:47,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:47,800 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:47,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for c2ed7014e8bd1f931be541a50400f5b9: 2023-07-12 10:54:47,802 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:47,802 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 34a5cb6595a97a0c97a10898a06c423a, disabling compactions & flushes 2023-07-12 10:54:47,802 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:47,802 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:47,802 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. after waiting 0 ms 2023-07-12 10:54:47,802 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:47,802 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:47,803 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 34a5cb6595a97a0c97a10898a06c423a: 2023-07-12 10:54:47,806 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:54:47,807 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159287807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159287807"}]},"ts":"1689159287807"} 2023-07-12 10:54:47,807 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159287807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159287807"}]},"ts":"1689159287807"} 2023-07-12 10:54:47,814 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:54:47,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:54:47,816 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159287816"}]},"ts":"1689159287816"} 2023-07-12 10:54:47,818 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 10:54:47,821 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:54:47,823 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:54:47,823 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:54:47,823 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:54:47,823 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:54:47,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2ed7014e8bd1f931be541a50400f5b9, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=34a5cb6595a97a0c97a10898a06c423a, ASSIGN}] 2023-07-12 10:54:47,826 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=34a5cb6595a97a0c97a10898a06c423a, ASSIGN 2023-07-12 10:54:47,826 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2ed7014e8bd1f931be541a50400f5b9, ASSIGN 2023-07-12 10:54:47,827 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=34a5cb6595a97a0c97a10898a06c423a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44589,1689159209836; forceNewPlan=false, retain=false 2023-07-12 10:54:47,830 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2ed7014e8bd1f931be541a50400f5b9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38185,1689159209730; forceNewPlan=false, retain=false 2023-07-12 10:54:47,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 10:54:47,977 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:54:47,980 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=34a5cb6595a97a0c97a10898a06c423a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:47,980 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c2ed7014e8bd1f931be541a50400f5b9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:47,981 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159287980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159287980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159287980"}]},"ts":"1689159287980"} 2023-07-12 10:54:47,981 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159287980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159287980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159287980"}]},"ts":"1689159287980"} 2023-07-12 10:54:47,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 34a5cb6595a97a0c97a10898a06c423a, server=jenkins-hbase9.apache.org,44589,1689159209836}] 2023-07-12 10:54:47,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure c2ed7014e8bd1f931be541a50400f5b9, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:54:48,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 10:54:48,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:48,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:48,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2ed7014e8bd1f931be541a50400f5b9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:54:48,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34a5cb6595a97a0c97a10898a06c423a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:54:48,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. service=AccessControlService 2023-07-12 10:54:48,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. service=AccessControlService 2023-07-12 10:54:48,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:48,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:54:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:54:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:54:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:54:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:54:48,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:54:48,144 INFO [StoreOpener-c2ed7014e8bd1f931be541a50400f5b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:54:48,144 INFO [StoreOpener-34a5cb6595a97a0c97a10898a06c423a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:54:48,147 DEBUG [StoreOpener-c2ed7014e8bd1f931be541a50400f5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/cf 2023-07-12 10:54:48,147 DEBUG [StoreOpener-34a5cb6595a97a0c97a10898a06c423a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/cf 2023-07-12 10:54:48,147 DEBUG [StoreOpener-c2ed7014e8bd1f931be541a50400f5b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/cf 2023-07-12 10:54:48,147 DEBUG [StoreOpener-34a5cb6595a97a0c97a10898a06c423a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/cf 2023-07-12 10:54:48,148 INFO [StoreOpener-34a5cb6595a97a0c97a10898a06c423a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34a5cb6595a97a0c97a10898a06c423a columnFamilyName cf 2023-07-12 10:54:48,148 INFO [StoreOpener-c2ed7014e8bd1f931be541a50400f5b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2ed7014e8bd1f931be541a50400f5b9 columnFamilyName cf 2023-07-12 10:54:48,158 INFO [StoreOpener-34a5cb6595a97a0c97a10898a06c423a-1] regionserver.HStore(310): Store=34a5cb6595a97a0c97a10898a06c423a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:48,158 INFO [StoreOpener-c2ed7014e8bd1f931be541a50400f5b9-1] regionserver.HStore(310): Store=c2ed7014e8bd1f931be541a50400f5b9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:48,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:54:48,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:54:48,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:54:48,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:54:48,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:54:48,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:54:48,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:48,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:48,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 34a5cb6595a97a0c97a10898a06c423a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63193822, jitterRate=-0.058338671922683716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:48,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 34a5cb6595a97a0c97a10898a06c423a: 2023-07-12 10:54:48,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c2ed7014e8bd1f931be541a50400f5b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73943233, jitterRate=0.10184003412723541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:48,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c2ed7014e8bd1f931be541a50400f5b9: 2023-07-12 10:54:48,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a., pid=60, masterSystemTime=1689159288135 2023-07-12 10:54:48,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9., pid=61, masterSystemTime=1689159288136 2023-07-12 10:54:48,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:48,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:48,170 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c2ed7014e8bd1f931be541a50400f5b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,170 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159288170"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159288170"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159288170"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159288170"}]},"ts":"1689159288170"} 2023-07-12 10:54:48,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:48,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:48,171 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=34a5cb6595a97a0c97a10898a06c423a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,171 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159288171"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159288171"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159288171"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159288171"}]},"ts":"1689159288171"} 2023-07-12 10:54:48,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-12 10:54:48,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure c2ed7014e8bd1f931be541a50400f5b9, server=jenkins-hbase9.apache.org,38185,1689159209730 in 188 msec 2023-07-12 10:54:48,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 10:54:48,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 34a5cb6595a97a0c97a10898a06c423a, server=jenkins-hbase9.apache.org,44589,1689159209836 in 191 msec 2023-07-12 10:54:48,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2ed7014e8bd1f931be541a50400f5b9, ASSIGN in 352 msec 2023-07-12 10:54:48,181 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-12 10:54:48,181 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=34a5cb6595a97a0c97a10898a06c423a, ASSIGN in 356 msec 2023-07-12 10:54:48,182 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:54:48,182 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159288182"}]},"ts":"1689159288182"} 2023-07-12 10:54:48,183 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 10:54:48,194 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:54:48,194 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 10:54:48,196 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 10:54:48,197 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:48,197 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:48,197 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:48,197 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:48,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:48,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:48,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:48,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:48,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 477 msec 2023-07-12 10:54:48,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 10:54:48,342 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 10:54:48,342 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-12 10:54:48,342 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:48,358 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-12 10:54:48,358 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:48,358 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-12 10:54:48,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:48,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159288369 (current time:1689159288369). 2023-07-12 10:54:48,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:48,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x6e446c42 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:48,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@242082a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:48,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:48,407 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:48,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e446c42 to 127.0.0.1:53956 2023-07-12 10:54:48,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:48,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x52c84d00 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:48,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f230d67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:48,517 DEBUG [hconnection-0x3fb6b9a1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:48,523 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:48,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52c84d00 to 127.0.0.1:53956 2023-07-12 10:54:48,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:48,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 10:54:48,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:48,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:48,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:48,556 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:48,560 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689159888560 2023-07-12 10:54:48,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:48,561 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,565 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:48,566 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:48,566 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:48,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:48,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 23 msec 2023-07-12 10:54:48,570 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:48,571 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689159888571 2023-07-12 10:54:48,671 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:48,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:48,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:48,673 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:48,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,695 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 10:54:48,695 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:48,695 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 10:54:48,695 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 10:54:48,696 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,696 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,697 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:48,697 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:48,698 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:48,698 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:48,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:48,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:48,698 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,698 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,700 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,700 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:48,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 10:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 10:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 10:54:48,701 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,701 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,702 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:48,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,705 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:48,705 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:48,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,708 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:48,708 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:48,708 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:48,708 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:48,708 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:48,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,714 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:48,714 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:48,714 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:48,714 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:48,714 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:48,715 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:48,715 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:48,715 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:48,716 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,716 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:48,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:48,718 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,718 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:48,718 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,718 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,718 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:48,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:48,718 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,718 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:48,718 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,719 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:48,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 10:54:48,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@346a6015[Count = 1] remaining members to acquire global barrier 2023-07-12 10:54:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:48,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:48,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:48,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:48,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 10:54:48,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@346a6015[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:48,724 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 10:54:48,724 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:48,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,726 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,726 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:48,726 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:48,727 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:48,727 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:54:48,727 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,727 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:48,729 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:48,729 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:48,730 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:48,730 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. started... 2023-07-12 10:54:48,733 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:48,741 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:48,741 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:48,741 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. started... 2023-07-12 10:54:48,739 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:48,741 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:48,741 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:48,739 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2ed7014e8bd1f931be541a50400f5b9: 2023-07-12 10:54:48,747 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,747 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:48,747 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:54:48,747 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34a5cb6595a97a0c97a10898a06c423a: 2023-07-12 10:54:48,748 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,748 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:48,748 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:54:48,782 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. completed. 2023-07-12 10:54:48,782 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:48,782 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:48,782 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:48,782 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,782 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:48,782 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:54:48,784 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,784 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:48,784 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:48,784 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:48,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:54:48,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 10:54:48,808 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. completed. 2023-07-12 10:54:48,808 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:48,809 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:48,809 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:48,809 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,809 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:48,809 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:54:48,810 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:48,810 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,810 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:48,811 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44589,1689159209836': 2023-07-12 10:54:48,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 10:54:48,817 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 10:54:48,818 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:48,818 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:48,818 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,818 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:48,819 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,820 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:48,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,820 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,820 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:48,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:48,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,821 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,821 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,821 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:48,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:48,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:48,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:48,822 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,823 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:48,823 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:48,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,825 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,826 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,827 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,846 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:48,846 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:48,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:48,846 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:48,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:48,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:48,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:48,846 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:48,847 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:48,847 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:48,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:48,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:48,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:48,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:48,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:48,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:48,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:48,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:48,850 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,850 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,850 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,850 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:48,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:48,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:48,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,851 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:48,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,873 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:48,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:48,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:48,875 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:54:48,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,175 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:49,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:49,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:49,177 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 10:54:49,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 10:54:49,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,334 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689159288562Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689159288851 (+289 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689159288851Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689159288862 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689159288871 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689159289333 (+462 ms) 2023-07-12 10:54:49,338 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:49,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 774 msec 2023-07-12 10:54:49,677 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:49,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:49,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:49,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38185] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:54:49,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44589] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:54:49,716 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,716 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:49,716 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:49,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:49,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159289738 (current time:1689159289738). 2023-07-12 10:54:49,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:49,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x0f1079cd to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:49,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ce69c36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:49,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:49,770 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:49,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f1079cd to 127.0.0.1:53956 2023-07-12 10:54:49,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:49,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x103df061 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:49,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c6f3dba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:49,788 DEBUG [hconnection-0x4430052d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:49,791 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:49,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x103df061 to 127.0.0.1:53956 2023-07-12 10:54:49,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:49,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 10:54:49,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:49,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:49,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:49,815 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:49,815 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689159889815 2023-07-12 10:54:49,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:49,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,817 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:49,819 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:49,819 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:49,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:49,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-12 10:54:49,821 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:49,822 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689159889822 2023-07-12 10:54:49,919 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:49,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:49,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:49,921 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:50,121 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:50,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:50,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:50,123 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:54:50,261 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 10:54:50,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,273 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 10:54:50,273 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:50,273 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 10:54:50,273 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 10:54:50,274 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,274 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,275 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,275 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,275 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,275 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,277 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,277 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 10:54:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:50,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,278 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,278 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 10:54:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 10:54:50,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:50,281 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,282 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:50,282 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:50,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,294 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:50,294 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:50,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,299 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:50,304 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:50,304 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:50,304 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:50,305 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,305 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,305 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,306 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:50,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,310 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,317 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,317 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,318 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:50,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 10:54:50,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bb97761[Count = 1] remaining members to acquire global barrier 2023-07-12 10:54:50,318 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,318 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:50,317 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 10:54:50,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bb97761[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:50,321 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 10:54:50,321 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:50,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,323 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:50,324 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:50,324 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:54:50,324 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,324 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:50,324 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:50,324 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:50,324 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,324 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:50,324 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:50,324 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:50,324 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:50,324 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. started... 2023-07-12 10:54:50,324 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:50,325 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c2ed7014e8bd1f931be541a50400f5b9 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 10:54:50,325 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. started... 2023-07-12 10:54:50,325 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 34a5cb6595a97a0c97a10898a06c423a 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 10:54:50,325 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:50,325 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:50,325 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:50,366 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/.tmp/cf/6268f2ef8d464e80994ad5bd7f997db5 2023-07-12 10:54:50,375 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/.tmp/cf/6268f2ef8d464e80994ad5bd7f997db5 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/cf/6268f2ef8d464e80994ad5bd7f997db5 2023-07-12 10:54:50,379 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/.tmp/cf/6ffe7eca479a444da364db116d1105e7 2023-07-12 10:54:50,383 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/cf/6268f2ef8d464e80994ad5bd7f997db5, entries=47, sequenceid=6, filesize=8 K 2023-07-12 10:54:50,385 INFO [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 34a5cb6595a97a0c97a10898a06c423a in 60ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:50,387 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34a5cb6595a97a0c97a10898a06c423a: 2023-07-12 10:54:50,387 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,387 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:50,387 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/cf/6268f2ef8d464e80994ad5bd7f997db5] hfiles 2023-07-12 10:54:50,388 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/cf/6268f2ef8d464e80994ad5bd7f997db5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,393 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/.tmp/cf/6ffe7eca479a444da364db116d1105e7 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/cf/6ffe7eca479a444da364db116d1105e7 2023-07-12 10:54:50,404 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/cf/6ffe7eca479a444da364db116d1105e7, entries=3, sequenceid=6, filesize=5.0 K 2023-07-12 10:54:50,405 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for c2ed7014e8bd1f931be541a50400f5b9 in 80ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:50,405 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2ed7014e8bd1f931be541a50400f5b9: 2023-07-12 10:54:50,406 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,406 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:50,406 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/cf/6ffe7eca479a444da364db116d1105e7] hfiles 2023-07-12 10:54:50,406 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/cf/6ffe7eca479a444da364db116d1105e7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,423 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:50,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:50,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:50,424 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 10:54:50,454 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. completed. 2023-07-12 10:54:50,454 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:54:50,454 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:50,455 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:50,455 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,455 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:50,455 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:54:50,456 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,456 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:50,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,457 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:50,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,457 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:50,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:54:50,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 10:54:50,836 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. completed. 2023-07-12 10:54:50,836 DEBUG [rs(jenkins-hbase9.apache.org,44589,1689159209836)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:54:50,836 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:50,836 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:50,836 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,836 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:50,836 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:54:50,839 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,839 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:50,839 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:50,839 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44589,1689159209836': 2023-07-12 10:54:50,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 10:54:50,845 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 10:54:50,846 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:50,846 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:50,846 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,846 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:50,850 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,850 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,850 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,850 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,851 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,851 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,862 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,866 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,868 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,869 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,869 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,873 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,873 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,873 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,874 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,874 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,874 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,874 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,874 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,874 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:50,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,874 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,877 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,877 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,877 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:50,877 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,877 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:50,877 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:50,877 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,877 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,924 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:50,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:50,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:50,927 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-12 10:54:50,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:51,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 10:54:51,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:51,040 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:51,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689159289816Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689159290876 (+1060 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689159290877 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689159290920 (+43 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689159290969 (+49 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689159291040 (+71 ms) 2023-07-12 10:54:51,043 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:51,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.2260 sec 2023-07-12 10:54:51,496 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:51,927 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:51,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:51,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:51,970 DEBUG [Listener at jenkins-hbase9.apache.org/37221] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:54:51,977 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:54:51,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35663] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 10:54:51,979 DEBUG [Listener at jenkins-hbase9.apache.org/37221] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:54:51,982 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:54:51,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38185] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 10:54:51,983 DEBUG [Listener at jenkins-hbase9.apache.org/37221] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:54:51,990 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:54:51,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44589] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 10:54:51,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:54:52,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,010 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:54:52,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 10:54:52,012 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:54:52,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 10:54:52,015 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,015 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,015 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690 empty. 2023-07-12 10:54:52,015 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221 empty. 2023-07-12 10:54:52,016 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,016 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,016 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 10:54:52,032 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 10:54:52,034 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 45b3b6bca89f2c7111765121dcad7221, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:54:52,038 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 95796a7b1044f61c39b92eb8ca253690, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:54:52,062 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:52,062 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 45b3b6bca89f2c7111765121dcad7221, disabling compactions & flushes 2023-07-12 10:54:52,062 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,062 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,062 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. after waiting 0 ms 2023-07-12 10:54:52,062 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,062 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,062 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 45b3b6bca89f2c7111765121dcad7221: 2023-07-12 10:54:52,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:52,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 95796a7b1044f61c39b92eb8ca253690, disabling compactions & flushes 2023-07-12 10:54:52,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. after waiting 0 ms 2023-07-12 10:54:52,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 95796a7b1044f61c39b92eb8ca253690: 2023-07-12 10:54:52,082 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:54:52,084 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159292083"}]},"ts":"1689159292083"} 2023-07-12 10:54:52,084 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159292083"}]},"ts":"1689159292083"} 2023-07-12 10:54:52,093 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:54:52,094 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:54:52,094 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159292094"}]},"ts":"1689159292094"} 2023-07-12 10:54:52,096 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 10:54:52,098 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:54:52,100 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:54:52,100 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:54:52,100 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:54:52,100 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:54:52,100 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95796a7b1044f61c39b92eb8ca253690, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=45b3b6bca89f2c7111765121dcad7221, ASSIGN}] 2023-07-12 10:54:52,103 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=45b3b6bca89f2c7111765121dcad7221, ASSIGN 2023-07-12 10:54:52,103 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95796a7b1044f61c39b92eb8ca253690, ASSIGN 2023-07-12 10:54:52,104 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=45b3b6bca89f2c7111765121dcad7221, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44589,1689159209836; forceNewPlan=false, retain=false 2023-07-12 10:54:52,104 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95796a7b1044f61c39b92eb8ca253690, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35663,1689159209791; forceNewPlan=false, retain=false 2023-07-12 10:54:52,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 10:54:52,254 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:54:52,257 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=95796a7b1044f61c39b92eb8ca253690, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:52,257 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=45b3b6bca89f2c7111765121dcad7221, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:52,258 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159292257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159292257"}]},"ts":"1689159292257"} 2023-07-12 10:54:52,258 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159292257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159292257"}]},"ts":"1689159292257"} 2023-07-12 10:54:52,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 95796a7b1044f61c39b92eb8ca253690, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:54:52,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 45b3b6bca89f2c7111765121dcad7221, server=jenkins-hbase9.apache.org,44589,1689159209836}] 2023-07-12 10:54:52,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 10:54:52,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45b3b6bca89f2c7111765121dcad7221, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 10:54:52,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. service=AccessControlService 2023-07-12 10:54:52,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:52,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:52,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,419 INFO [StoreOpener-45b3b6bca89f2c7111765121dcad7221-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,420 DEBUG [StoreOpener-45b3b6bca89f2c7111765121dcad7221-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/cf 2023-07-12 10:54:52,420 DEBUG [StoreOpener-45b3b6bca89f2c7111765121dcad7221-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/cf 2023-07-12 10:54:52,421 INFO [StoreOpener-45b3b6bca89f2c7111765121dcad7221-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45b3b6bca89f2c7111765121dcad7221 columnFamilyName cf 2023-07-12 10:54:52,422 INFO [StoreOpener-45b3b6bca89f2c7111765121dcad7221-1] regionserver.HStore(310): Store=45b3b6bca89f2c7111765121dcad7221/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:52,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 95796a7b1044f61c39b92eb8ca253690, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 10:54:52,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. service=AccessControlService 2023-07-12 10:54:52,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:52,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:52,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,426 INFO [StoreOpener-95796a7b1044f61c39b92eb8ca253690-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,429 DEBUG [StoreOpener-95796a7b1044f61c39b92eb8ca253690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/cf 2023-07-12 10:54:52,429 DEBUG [StoreOpener-95796a7b1044f61c39b92eb8ca253690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/cf 2023-07-12 10:54:52,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:52,429 INFO [StoreOpener-95796a7b1044f61c39b92eb8ca253690-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95796a7b1044f61c39b92eb8ca253690 columnFamilyName cf 2023-07-12 10:54:52,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 45b3b6bca89f2c7111765121dcad7221; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69452749, jitterRate=0.034926608204841614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:52,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 45b3b6bca89f2c7111765121dcad7221: 2023-07-12 10:54:52,430 INFO [StoreOpener-95796a7b1044f61c39b92eb8ca253690-1] regionserver.HStore(310): Store=95796a7b1044f61c39b92eb8ca253690/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:52,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221., pid=70, masterSystemTime=1689159292412 2023-07-12 10:54:52,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,434 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=45b3b6bca89f2c7111765121dcad7221, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:52,434 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292434"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159292434"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159292434"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159292434"}]},"ts":"1689159292434"} 2023-07-12 10:54:52,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-12 10:54:52,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 45b3b6bca89f2c7111765121dcad7221, server=jenkins-hbase9.apache.org,44589,1689159209836 in 177 msec 2023-07-12 10:54:52,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=45b3b6bca89f2c7111765121dcad7221, ASSIGN in 339 msec 2023-07-12 10:54:52,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:52,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 95796a7b1044f61c39b92eb8ca253690; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67118572, jitterRate=1.4466047286987305E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:52,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 95796a7b1044f61c39b92eb8ca253690: 2023-07-12 10:54:52,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690., pid=69, masterSystemTime=1689159292412 2023-07-12 10:54:52,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,455 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=95796a7b1044f61c39b92eb8ca253690, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:52,455 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292455"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159292455"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159292455"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159292455"}]},"ts":"1689159292455"} 2023-07-12 10:54:52,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-12 10:54:52,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 95796a7b1044f61c39b92eb8ca253690, server=jenkins-hbase9.apache.org,35663,1689159209791 in 198 msec 2023-07-12 10:54:52,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 10:54:52,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95796a7b1044f61c39b92eb8ca253690, ASSIGN in 360 msec 2023-07-12 10:54:52,465 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:54:52,466 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159292465"}]},"ts":"1689159292465"} 2023-07-12 10:54:52,468 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 10:54:52,472 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:54:52,473 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 10:54:52,475 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 10:54:52,477 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:52,477 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:52,477 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:52,477 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:52,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:52,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:52,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:52,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:52,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:52,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:52,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:52,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:52,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 479 msec 2023-07-12 10:54:52,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 10:54:52,615 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 10:54:52,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions 95796a7b1044f61c39b92eb8ca253690, 45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[95796a7b1044f61c39b92eb8ca253690, 45b3b6bca89f2c7111765121dcad7221], force=true 2023-07-12 10:54:52,657 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[95796a7b1044f61c39b92eb8ca253690, 45b3b6bca89f2c7111765121dcad7221], force=true 2023-07-12 10:54:52,657 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[95796a7b1044f61c39b92eb8ca253690, 45b3b6bca89f2c7111765121dcad7221], force=true 2023-07-12 10:54:52,657 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[95796a7b1044f61c39b92eb8ca253690, 45b3b6bca89f2c7111765121dcad7221], force=true 2023-07-12 10:54:52,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:52,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95796a7b1044f61c39b92eb8ca253690, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=45b3b6bca89f2c7111765121dcad7221, UNASSIGN}] 2023-07-12 10:54:52,692 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=45b3b6bca89f2c7111765121dcad7221, UNASSIGN 2023-07-12 10:54:52,694 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95796a7b1044f61c39b92eb8ca253690, UNASSIGN 2023-07-12 10:54:52,695 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=45b3b6bca89f2c7111765121dcad7221, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:52,695 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=95796a7b1044f61c39b92eb8ca253690, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:52,695 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159292695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159292695"}]},"ts":"1689159292695"} 2023-07-12 10:54:52,695 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159292695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159292695"}]},"ts":"1689159292695"} 2023-07-12 10:54:52,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 45b3b6bca89f2c7111765121dcad7221, server=jenkins-hbase9.apache.org,44589,1689159209836}] 2023-07-12 10:54:52,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 95796a7b1044f61c39b92eb8ca253690, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:54:52,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:52,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 45b3b6bca89f2c7111765121dcad7221, disabling compactions & flushes 2023-07-12 10:54:52,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. after waiting 0 ms 2023-07-12 10:54:52,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 45b3b6bca89f2c7111765121dcad7221 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 10:54:52,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 95796a7b1044f61c39b92eb8ca253690, disabling compactions & flushes 2023-07-12 10:54:52,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. after waiting 0 ms 2023-07-12 10:54:52,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 95796a7b1044f61c39b92eb8ca253690 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 10:54:52,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/.tmp/cf/9dc293ec90b3421f93b4184222c239ab 2023-07-12 10:54:52,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/.tmp/cf/174308d0cd7e4bd58da4d854b0200000 2023-07-12 10:54:52,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/.tmp/cf/174308d0cd7e4bd58da4d854b0200000 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/cf/174308d0cd7e4bd58da4d854b0200000 2023-07-12 10:54:52,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/.tmp/cf/9dc293ec90b3421f93b4184222c239ab as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/cf/9dc293ec90b3421f93b4184222c239ab 2023-07-12 10:54:52,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/cf/9dc293ec90b3421f93b4184222c239ab, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 10:54:52,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 95796a7b1044f61c39b92eb8ca253690 in 52ms, sequenceid=5, compaction requested=false 2023-07-12 10:54:52,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 10:54:52,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/cf/174308d0cd7e4bd58da4d854b0200000, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 10:54:52,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 45b3b6bca89f2c7111765121dcad7221 in 56ms, sequenceid=5, compaction requested=false 2023-07-12 10:54:52,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 10:54:52,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:52,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221. 2023-07-12 10:54:52,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 45b3b6bca89f2c7111765121dcad7221: 2023-07-12 10:54:52,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 10:54:52,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:52,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690. 2023-07-12 10:54:52,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 95796a7b1044f61c39b92eb8ca253690: 2023-07-12 10:54:52,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:54:52,941 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=45b3b6bca89f2c7111765121dcad7221, regionState=CLOSED 2023-07-12 10:54:52,941 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292941"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159292941"}]},"ts":"1689159292941"} 2023-07-12 10:54:52,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:54:52,942 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=95796a7b1044f61c39b92eb8ca253690, regionState=CLOSED 2023-07-12 10:54:52,942 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159292942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159292942"}]},"ts":"1689159292942"} 2023-07-12 10:54:52,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-12 10:54:52,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 45b3b6bca89f2c7111765121dcad7221, server=jenkins-hbase9.apache.org,44589,1689159209836 in 246 msec 2023-07-12 10:54:52,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-12 10:54:52,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 95796a7b1044f61c39b92eb8ca253690, server=jenkins-hbase9.apache.org,35663,1689159209791 in 246 msec 2023-07-12 10:54:52,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=45b3b6bca89f2c7111765121dcad7221, UNASSIGN in 255 msec 2023-07-12 10:54:52,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-12 10:54:52,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95796a7b1044f61c39b92eb8ca253690, UNASSIGN in 260 msec 2023-07-12 10:54:52,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:53,011 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 10:54:53,013 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291999.95796a7b1044f61c39b92eb8ca253690.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:53,013 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291999.45b3b6bca89f2c7111765121dcad7221.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:53,013 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:53,030 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:54:53,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=05a674c359ce902259b3052aa25a42b0, ASSIGN}] 2023-07-12 10:54:53,077 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=05a674c359ce902259b3052aa25a42b0, ASSIGN 2023-07-12 10:54:53,078 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=05a674c359ce902259b3052aa25a42b0, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,35663,1689159209791; forceNewPlan=false, retain=false 2023-07-12 10:54:53,228 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 10:54:53,230 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=05a674c359ce902259b3052aa25a42b0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:53,230 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689159293230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159293230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159293230"}]},"ts":"1689159293230"} 2023-07-12 10:54:53,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 05a674c359ce902259b3052aa25a42b0, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:54:53,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:53,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. 2023-07-12 10:54:53,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 05a674c359ce902259b3052aa25a42b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:54:53,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. service=AccessControlService 2023-07-12 10:54:53,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:53,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 05a674c359ce902259b3052aa25a42b0 2023-07-12 10:54:53,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:53,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 05a674c359ce902259b3052aa25a42b0 2023-07-12 10:54:53,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 05a674c359ce902259b3052aa25a42b0 2023-07-12 10:54:53,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/.regioninfo 2023-07-12 10:54:53,412 INFO [StoreOpener-05a674c359ce902259b3052aa25a42b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 05a674c359ce902259b3052aa25a42b0 2023-07-12 10:54:53,414 DEBUG [StoreOpener-05a674c359ce902259b3052aa25a42b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf 2023-07-12 10:54:53,414 DEBUG [StoreOpener-05a674c359ce902259b3052aa25a42b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf 2023-07-12 10:54:53,415 INFO [StoreOpener-05a674c359ce902259b3052aa25a42b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05a674c359ce902259b3052aa25a42b0 columnFamilyName cf 2023-07-12 10:54:53,453 DEBUG [StoreOpener-05a674c359ce902259b3052aa25a42b0-1] regionserver.HStore(539): loaded hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/174308d0cd7e4bd58da4d854b0200000.45b3b6bca89f2c7111765121dcad7221->hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/cf/174308d0cd7e4bd58da4d854b0200000-top 2023-07-12 10:54:53,460 DEBUG [StoreOpener-05a674c359ce902259b3052aa25a42b0-1] regionserver.HStore(539): loaded hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/9dc293ec90b3421f93b4184222c239ab.95796a7b1044f61c39b92eb8ca253690->hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/cf/9dc293ec90b3421f93b4184222c239ab-top 2023-07-12 10:54:53,460 INFO [StoreOpener-05a674c359ce902259b3052aa25a42b0-1] regionserver.HStore(310): Store=05a674c359ce902259b3052aa25a42b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:53,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0 2023-07-12 10:54:53,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0 2023-07-12 10:54:53,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 05a674c359ce902259b3052aa25a42b0 2023-07-12 10:54:53,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 05a674c359ce902259b3052aa25a42b0; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65454860, jitterRate=-0.0246465802192688}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:53,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 05a674c359ce902259b3052aa25a42b0: 2023-07-12 10:54:53,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0., pid=77, masterSystemTime=1689159293385 2023-07-12 10:54:53,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.,because compaction is disabled. 2023-07-12 10:54:53,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. 2023-07-12 10:54:53,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. 2023-07-12 10:54:53,470 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=05a674c359ce902259b3052aa25a42b0, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:53,470 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689159293470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159293470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159293470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159293470"}]},"ts":"1689159293470"} 2023-07-12 10:54:53,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 10:54:53,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 05a674c359ce902259b3052aa25a42b0, server=jenkins-hbase9.apache.org,35663,1689159209791 in 239 msec 2023-07-12 10:54:53,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 10:54:53,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=05a674c359ce902259b3052aa25a42b0, ASSIGN in 399 msec 2023-07-12 10:54:53,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[95796a7b1044f61c39b92eb8ca253690, 45b3b6bca89f2c7111765121dcad7221], force=true in 826 msec 2023-07-12 10:54:53,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:53,769 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 10:54:53,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 10:54:53,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159293770 (current time:1689159293770). 2023-07-12 10:54:53,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:53,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x2a2ab75a to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:53,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@735bd5cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:53,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:53,810 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:53,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a2ab75a to 127.0.0.1:53956 2023-07-12 10:54:53,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:53,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x4ac0f8af to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:53,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35af16ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:53,855 DEBUG [hconnection-0x18f7580f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:53,859 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:53,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ac0f8af to 127.0.0.1:53956 2023-07-12 10:54:53,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:53,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 10:54:53,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:53,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 10:54:53,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 10:54:53,872 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 10:54:53,872 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689159893872 2023-07-12 10:54:53,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 10:54:53,872 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,873 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:53,873 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:53,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 10:54:53,886 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 10:54:53,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 17 msec 2023-07-12 10:54:53,889 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 10:54:53,890 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689159893890 2023-07-12 10:54:53,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,949 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 10:54:53,949 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:53,951 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 10:54:53,951 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 10:54:53,973 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:53,974 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,974 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 10:54:53,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:53,975 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:53,975 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:53,975 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:53,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:53,975 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:53,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:53,975 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:53,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:53,977 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:53,977 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,978 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 10:54:53,978 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:53,978 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 10:54:53,979 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:53,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,979 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 10:54:53,979 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:53,981 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 10:54:53,981 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 10:54:53,981 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 10:54:53,981 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 10:54:53,981 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 10:54:53,981 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 10:54:53,981 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 10:54:53,981 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 10:54:53,981 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 10:54:53,983 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,984 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,984 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:53,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 10:54:53,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9bd3a92[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:53,987 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 10:54:53,987 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,989 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,989 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,989 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,989 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:53,989 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,989 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 10:54:53,990 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 10:54:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,990 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 10:54:53,990 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 10:54:53,990 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 10:54:53,990 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:53,990 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:53,990 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:54:53,990 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. 2023-07-12 10:54:53,990 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:54:53,990 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. started... 2023-07-12 10:54:53,992 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05a674c359ce902259b3052aa25a42b0: 2023-07-12 10:54:53,992 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,992 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:53,992 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/174308d0cd7e4bd58da4d854b0200000.45b3b6bca89f2c7111765121dcad7221->hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/cf/174308d0cd7e4bd58da4d854b0200000-top, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/9dc293ec90b3421f93b4184222c239ab.95796a7b1044f61c39b92eb8ca253690->hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/cf/9dc293ec90b3421f93b4184222c239ab-top] hfiles 2023-07-12 10:54:53,992 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/174308d0cd7e4bd58da4d854b0200000.45b3b6bca89f2c7111765121dcad7221 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,993 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 10:54:53,993 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:53,993 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 10:54:53,993 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/9dc293ec90b3421f93b4184222c239ab.95796a7b1044f61c39b92eb8ca253690 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,998 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 10:54:53,998 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:53,998 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 10:54:54,020 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. completed. 2023-07-12 10:54:54,020 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. 2023-07-12 10:54:54,020 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:54,020 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:54,020 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,021 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 10:54:54,021 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:54:54,027 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,027 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 10:54:54,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,028 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:54,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:54,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:54,028 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 10:54:54,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:54,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:54,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:54,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:54,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:54,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:54,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:54,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,35663,1689159209791': 2023-07-12 10:54:54,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 10:54:54,032 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 10:54:54,032 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:54,032 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:54,032 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,032 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:54,034 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,034 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,034 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,034 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:54,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,035 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,034 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:54,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,034 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:54,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:54,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:54,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:54,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:54,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:54,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:54,035 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:54,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:54,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:54,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:54,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,036 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:54,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,037 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:54,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:54,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:54,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,039 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:54,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:54,039 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:54,040 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:54,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:54,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:54,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:54,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,044 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:54,045 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:54,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:54,044 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,044 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:54:54,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:54,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:54,045 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,045 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:54:54,045 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:54:54,045 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,046 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:54,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,173 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 10:54:54,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,174 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689159293873Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689159294045 (+172 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689159294045Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689159294050 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689159294066 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689159294173 (+107 ms) 2023-07-12 10:54:54,176 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:54,178 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 10:54:54,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 10:54:54,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:54,180 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 298 msec 2023-07-12 10:54:54,180 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180 2023-07-12 10:54:54,180 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37511, tgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180, rawTgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180, srcFsUri=hdfs://localhost:37511, srcDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:54:54,224 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:54:54,224 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-950377312_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,224 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7, snapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 10:54:54,255 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:54,333 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,334 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,334 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,334 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,335 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,335 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,335 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,429 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop-5474102144202809839.jar 2023-07-12 10:54:54,429 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,430 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,431 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,431 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,432 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,432 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:54,433 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:54:54,433 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:54:54,434 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:54:54,435 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:54:54,435 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:54:54,436 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:54:54,436 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:54:54,437 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:54:54,437 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:54:54,438 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:54:54,439 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:54,439 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:54,440 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:54,440 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:54,441 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:54,441 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:54,442 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:55,037 WARN [Listener at jenkins-hbase9.apache.org/37221] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:54:55,039 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 10:54:55,042 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 10:54:55,527 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:55,527 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:56,314 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0005_000001 (auth:SIMPLE) 2023-07-12 10:54:57,921 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:55:02,938 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0005_000001 (auth:SIMPLE) 2023-07-12 10:55:05,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0005_000001 (auth:SIMPLE) 2023-07-12 10:55:10,732 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:55:10,735 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:55:10,770 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:10,770 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:55:10,771 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:55:10,771 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:10,771 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 10:55:10,772 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 10:55:10,772 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:10,772 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 10:55:10,772 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159294180/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 10:55:10,782 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:10,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:10,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:10,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 10:55:10,788 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159310788"}]},"ts":"1689159310788"} 2023-07-12 10:55:10,790 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 10:55:10,792 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 10:55:10,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=05a674c359ce902259b3052aa25a42b0, UNASSIGN}] 2023-07-12 10:55:10,795 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=05a674c359ce902259b3052aa25a42b0, UNASSIGN 2023-07-12 10:55:10,796 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=05a674c359ce902259b3052aa25a42b0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:10,796 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689159310796"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159310796"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159310796"}]},"ts":"1689159310796"} 2023-07-12 10:55:10,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 05a674c359ce902259b3052aa25a42b0, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:55:10,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 10:55:10,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 05a674c359ce902259b3052aa25a42b0 2023-07-12 10:55:10,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 05a674c359ce902259b3052aa25a42b0, disabling compactions & flushes 2023-07-12 10:55:10,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. 2023-07-12 10:55:10,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. 2023-07-12 10:55:10,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. after waiting 0 ms 2023-07-12 10:55:10,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. 2023-07-12 10:55:10,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 10:55:10,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:10,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0. 2023-07-12 10:55:10,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 05a674c359ce902259b3052aa25a42b0: 2023-07-12 10:55:10,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 05a674c359ce902259b3052aa25a42b0 2023-07-12 10:55:10,972 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=05a674c359ce902259b3052aa25a42b0, regionState=CLOSED 2023-07-12 10:55:10,972 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689159310972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159310972"}]},"ts":"1689159310972"} 2023-07-12 10:55:10,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 10:55:10,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 05a674c359ce902259b3052aa25a42b0, server=jenkins-hbase9.apache.org,35663,1689159209791 in 177 msec 2023-07-12 10:55:10,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 10:55:10,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=05a674c359ce902259b3052aa25a42b0, UNASSIGN in 186 msec 2023-07-12 10:55:10,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159310983"}]},"ts":"1689159310983"} 2023-07-12 10:55:10,985 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 10:55:10,987 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 10:55:10,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 204 msec 2023-07-12 10:55:11,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 10:55:11,091 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 10:55:11,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,096 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,098 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,099 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,109 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,111 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,111 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 10:55:11,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 10:55:11,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 10:55:11,114 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 10:55:11,117 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,117 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,117 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:11,117 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,117 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:11,117 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,117 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:11,117 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:11,118 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:11,118 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:11,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 10:55:11,119 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:11,119 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:11,128 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0 2023-07-12 10:55:11,134 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/recovered.edits] 2023-07-12 10:55:11,141 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/174308d0cd7e4bd58da4d854b0200000.45b3b6bca89f2c7111765121dcad7221 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/174308d0cd7e4bd58da4d854b0200000.45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:55:11,141 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:55:11,142 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:55:11,144 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/recovered.edits] 2023-07-12 10:55:11,144 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/9dc293ec90b3421f93b4184222c239ab.95796a7b1044f61c39b92eb8ca253690 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/cf/9dc293ec90b3421f93b4184222c239ab.95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:55:11,144 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/recovered.edits] 2023-07-12 10:55:11,149 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/cf/174308d0cd7e4bd58da4d854b0200000 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/cf/174308d0cd7e4bd58da4d854b0200000 2023-07-12 10:55:11,150 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/recovered.edits/12.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0/recovered.edits/12.seqid 2023-07-12 10:55:11,150 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/cf/9dc293ec90b3421f93b4184222c239ab to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/cf/9dc293ec90b3421f93b4184222c239ab 2023-07-12 10:55:11,152 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/05a674c359ce902259b3052aa25a42b0 2023-07-12 10:55:11,155 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/recovered.edits/8.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221/recovered.edits/8.seqid 2023-07-12 10:55:11,155 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/recovered.edits/8.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690/recovered.edits/8.seqid 2023-07-12 10:55:11,156 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95796a7b1044f61c39b92eb8ca253690 2023-07-12 10:55:11,156 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/45b3b6bca89f2c7111765121dcad7221 2023-07-12 10:55:11,156 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 10:55:11,158 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,162 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 10:55:11,169 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 10:55:11,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 10:55:11,174 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159311174"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:11,176 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 10:55:11,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 05a674c359ce902259b3052aa25a42b0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159292000.05a674c359ce902259b3052aa25a42b0.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 10:55:11,176 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 10:55:11,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159311176"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:11,178 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 10:55:11,182 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 90 msec 2023-07-12 10:55:11,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 10:55:11,220 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 10:55:11,221 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 10:55:11,226 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159311226"}]},"ts":"1689159311226"} 2023-07-12 10:55:11,227 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 10:55:11,229 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 10:55:11,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2ed7014e8bd1f931be541a50400f5b9, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=34a5cb6595a97a0c97a10898a06c423a, UNASSIGN}] 2023-07-12 10:55:11,232 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=34a5cb6595a97a0c97a10898a06c423a, UNASSIGN 2023-07-12 10:55:11,232 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2ed7014e8bd1f931be541a50400f5b9, UNASSIGN 2023-07-12 10:55:11,233 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c2ed7014e8bd1f931be541a50400f5b9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:11,233 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=34a5cb6595a97a0c97a10898a06c423a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:11,233 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159311233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159311233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159311233"}]},"ts":"1689159311233"} 2023-07-12 10:55:11,233 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159311233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159311233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159311233"}]},"ts":"1689159311233"} 2023-07-12 10:55:11,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure c2ed7014e8bd1f931be541a50400f5b9, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:55:11,236 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 34a5cb6595a97a0c97a10898a06c423a, server=jenkins-hbase9.apache.org,44589,1689159209836}] 2023-07-12 10:55:11,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 10:55:11,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:55:11,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c2ed7014e8bd1f931be541a50400f5b9, disabling compactions & flushes 2023-07-12 10:55:11,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:55:11,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:55:11,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. after waiting 0 ms 2023-07-12 10:55:11,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:55:11,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:55:11,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 34a5cb6595a97a0c97a10898a06c423a, disabling compactions & flushes 2023-07-12 10:55:11,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:55:11,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:55:11,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. after waiting 0 ms 2023-07-12 10:55:11,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:55:11,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:11,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:11,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:11,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a. 2023-07-12 10:55:11,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 34a5cb6595a97a0c97a10898a06c423a: 2023-07-12 10:55:11,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:11,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9. 2023-07-12 10:55:11,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c2ed7014e8bd1f931be541a50400f5b9: 2023-07-12 10:55:11,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:55:11,415 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=34a5cb6595a97a0c97a10898a06c423a, regionState=CLOSED 2023-07-12 10:55:11,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:55:11,415 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159311415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159311415"}]},"ts":"1689159311415"} 2023-07-12 10:55:11,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c2ed7014e8bd1f931be541a50400f5b9, regionState=CLOSED 2023-07-12 10:55:11,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159311418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159311418"}]},"ts":"1689159311418"} 2023-07-12 10:55:11,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-12 10:55:11,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 34a5cb6595a97a0c97a10898a06c423a, server=jenkins-hbase9.apache.org,44589,1689159209836 in 181 msec 2023-07-12 10:55:11,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=34a5cb6595a97a0c97a10898a06c423a, UNASSIGN in 190 msec 2023-07-12 10:55:11,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-12 10:55:11,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure c2ed7014e8bd1f931be541a50400f5b9, server=jenkins-hbase9.apache.org,38185,1689159209730 in 184 msec 2023-07-12 10:55:11,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-12 10:55:11,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c2ed7014e8bd1f931be541a50400f5b9, UNASSIGN in 191 msec 2023-07-12 10:55:11,424 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159311424"}]},"ts":"1689159311424"} 2023-07-12 10:55:11,426 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 10:55:11,430 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 10:55:11,431 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 209 msec 2023-07-12 10:55:11,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 10:55:11,529 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 10:55:11,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,542 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,544 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,545 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,548 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,548 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,548 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,548 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 10:55:11,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 10:55:11,549 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 10:55:11,549 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:55:11,549 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:55:11,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 10:55:11,549 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,549 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,549 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,549 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:11,550 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,550 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:11,549 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:11,549 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:11,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 10:55:11,551 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/recovered.edits] 2023-07-12 10:55:11,551 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/recovered.edits] 2023-07-12 10:55:11,556 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/cf/6268f2ef8d464e80994ad5bd7f997db5 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/cf/6268f2ef8d464e80994ad5bd7f997db5 2023-07-12 10:55:11,556 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/cf/6ffe7eca479a444da364db116d1105e7 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/cf/6ffe7eca479a444da364db116d1105e7 2023-07-12 10:55:11,560 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a/recovered.edits/9.seqid 2023-07-12 10:55:11,561 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9/recovered.edits/9.seqid 2023-07-12 10:55:11,561 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/34a5cb6595a97a0c97a10898a06c423a 2023-07-12 10:55:11,561 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c2ed7014e8bd1f931be541a50400f5b9 2023-07-12 10:55:11,561 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 10:55:11,565 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,572 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 10:55:11,574 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 10:55:11,575 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,575 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 10:55:11,575 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159311575"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:11,575 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159311575"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:11,578 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:55:11,578 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c2ed7014e8bd1f931be541a50400f5b9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689159287725.c2ed7014e8bd1f931be541a50400f5b9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 34a5cb6595a97a0c97a10898a06c423a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159287725.34a5cb6595a97a0c97a10898a06c423a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:55:11,578 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 10:55:11,578 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159311578"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:11,582 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 10:55:11,585 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 55 msec 2023-07-12 10:55:11,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 10:55:11,652 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 10:55:11,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 10:55:11,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 10:55:11,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:11,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 10:55:11,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:11,714 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 751) Potentially hanging thread: hconnection-0x45150b13-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4180 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1975163258_1 at /127.0.0.1:58698 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:43354 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:38201 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:60360 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:41876 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=900 (was 906), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=625 (was 409) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=5620 (was 6616) 2023-07-12 10:55:11,715 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 10:55:11,748 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=625, ProcessCount=182, AvailableMemoryMB=5615 2023-07-12 10:55:11,748 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 10:55:11,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:55:11,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:11,757 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:55:11,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 10:55:11,758 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:55:11,761 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:11,761 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:11,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 10:55:11,762 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb empty. 2023-07-12 10:55:11,762 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88 empty. 2023-07-12 10:55:11,762 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:11,762 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:11,762 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 10:55:11,787 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 10:55:11,789 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 43ba08abbbd4dd829e37f70209ed98eb, NAME => 'testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:55:11,791 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => faa47ebd737f47ea5139ad41c1f66b88, NAME => 'testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:55:11,834 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:11,858 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 43ba08abbbd4dd829e37f70209ed98eb, disabling compactions & flushes 2023-07-12 10:55:11,858 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:11,858 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:11,858 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. after waiting 0 ms 2023-07-12 10:55:11,858 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:11,858 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:11,858 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 43ba08abbbd4dd829e37f70209ed98eb: 2023-07-12 10:55:11,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 10:55:11,877 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:11,877 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing faa47ebd737f47ea5139ad41c1f66b88, disabling compactions & flushes 2023-07-12 10:55:11,877 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:11,877 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:11,878 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. after waiting 0 ms 2023-07-12 10:55:11,878 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:11,878 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:11,878 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for faa47ebd737f47ea5139ad41c1f66b88: 2023-07-12 10:55:11,880 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:55:11,882 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159311882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159311882"}]},"ts":"1689159311882"} 2023-07-12 10:55:11,882 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159311882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159311882"}]},"ts":"1689159311882"} 2023-07-12 10:55:11,884 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:55:11,886 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:55:11,886 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159311886"}]},"ts":"1689159311886"} 2023-07-12 10:55:11,887 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 10:55:11,892 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:55:11,893 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:55:11,893 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:55:11,893 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:55:11,893 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:55:11,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=43ba08abbbd4dd829e37f70209ed98eb, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=faa47ebd737f47ea5139ad41c1f66b88, ASSIGN}] 2023-07-12 10:55:11,898 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=faa47ebd737f47ea5139ad41c1f66b88, ASSIGN 2023-07-12 10:55:11,898 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=43ba08abbbd4dd829e37f70209ed98eb, ASSIGN 2023-07-12 10:55:11,900 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=faa47ebd737f47ea5139ad41c1f66b88, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38185,1689159209730; forceNewPlan=false, retain=false 2023-07-12 10:55:11,900 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=43ba08abbbd4dd829e37f70209ed98eb, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35663,1689159209791; forceNewPlan=false, retain=false 2023-07-12 10:55:12,050 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:55:12,053 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=faa47ebd737f47ea5139ad41c1f66b88, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,054 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=43ba08abbbd4dd829e37f70209ed98eb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,054 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159312053"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159312053"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159312053"}]},"ts":"1689159312053"} 2023-07-12 10:55:12,054 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159312053"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159312053"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159312053"}]},"ts":"1689159312053"} 2023-07-12 10:55:12,056 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 43ba08abbbd4dd829e37f70209ed98eb, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:55:12,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure faa47ebd737f47ea5139ad41c1f66b88, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:55:12,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 10:55:12,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:12,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => faa47ebd737f47ea5139ad41c1f66b88, NAME => 'testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:55:12,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. service=AccessControlService 2023-07-12 10:55:12,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:55:12,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:12,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:12,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:12,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:12,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 43ba08abbbd4dd829e37f70209ed98eb, NAME => 'testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:55:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. service=AccessControlService 2023-07-12 10:55:12,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:55:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:12,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:12,222 INFO [StoreOpener-faa47ebd737f47ea5139ad41c1f66b88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:12,223 INFO [StoreOpener-43ba08abbbd4dd829e37f70209ed98eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:12,225 DEBUG [StoreOpener-faa47ebd737f47ea5139ad41c1f66b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/cf 2023-07-12 10:55:12,225 DEBUG [StoreOpener-43ba08abbbd4dd829e37f70209ed98eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/cf 2023-07-12 10:55:12,225 DEBUG [StoreOpener-faa47ebd737f47ea5139ad41c1f66b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/cf 2023-07-12 10:55:12,226 INFO [StoreOpener-faa47ebd737f47ea5139ad41c1f66b88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region faa47ebd737f47ea5139ad41c1f66b88 columnFamilyName cf 2023-07-12 10:55:12,225 DEBUG [StoreOpener-43ba08abbbd4dd829e37f70209ed98eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/cf 2023-07-12 10:55:12,226 INFO [StoreOpener-43ba08abbbd4dd829e37f70209ed98eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43ba08abbbd4dd829e37f70209ed98eb columnFamilyName cf 2023-07-12 10:55:12,226 INFO [StoreOpener-faa47ebd737f47ea5139ad41c1f66b88-1] regionserver.HStore(310): Store=faa47ebd737f47ea5139ad41c1f66b88/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:55:12,227 INFO [StoreOpener-43ba08abbbd4dd829e37f70209ed98eb-1] regionserver.HStore(310): Store=43ba08abbbd4dd829e37f70209ed98eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:55:12,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:12,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:12,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:12,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:12,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:55:12,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened faa47ebd737f47ea5139ad41c1f66b88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71655622, jitterRate=0.06775197386741638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:55:12,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for faa47ebd737f47ea5139ad41c1f66b88: 2023-07-12 10:55:12,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:12,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88., pid=94, masterSystemTime=1689159312211 2023-07-12 10:55:12,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:12,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:12,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=faa47ebd737f47ea5139ad41c1f66b88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,237 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159312236"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159312236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159312236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159312236"}]},"ts":"1689159312236"} 2023-07-12 10:55:12,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:12,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-12 10:55:12,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure faa47ebd737f47ea5139ad41c1f66b88, server=jenkins-hbase9.apache.org,38185,1689159209730 in 181 msec 2023-07-12 10:55:12,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=faa47ebd737f47ea5139ad41c1f66b88, ASSIGN in 347 msec 2023-07-12 10:55:12,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:55:12,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 43ba08abbbd4dd829e37f70209ed98eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70482914, jitterRate=0.050277262926101685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:55:12,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 43ba08abbbd4dd829e37f70209ed98eb: 2023-07-12 10:55:12,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb., pid=93, masterSystemTime=1689159312210 2023-07-12 10:55:12,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:12,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:12,257 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=43ba08abbbd4dd829e37f70209ed98eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,257 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159312257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159312257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159312257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159312257"}]},"ts":"1689159312257"} 2023-07-12 10:55:12,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-12 10:55:12,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 43ba08abbbd4dd829e37f70209ed98eb, server=jenkins-hbase9.apache.org,35663,1689159209791 in 203 msec 2023-07-12 10:55:12,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-12 10:55:12,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=43ba08abbbd4dd829e37f70209ed98eb, ASSIGN in 369 msec 2023-07-12 10:55:12,266 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:55:12,266 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159312266"}]},"ts":"1689159312266"} 2023-07-12 10:55:12,268 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 10:55:12,275 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:55:12,276 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 10:55:12,278 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:55:12,279 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:12,279 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:12,279 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:12,279 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:12,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:12,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:12,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:12,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:12,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:12,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:12,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:12,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:12,284 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 531 msec 2023-07-12 10:55:12,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 10:55:12,366 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 10:55:12,366 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 10:55:12,366 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:12,370 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 10:55:12,370 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:12,370 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-12 10:55:12,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:12,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159312373 (current time:1689159312373). 2023-07-12 10:55:12,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:55:12,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x6af6a48d to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:12,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a82f9e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:12,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:12,393 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:12,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6af6a48d to 127.0.0.1:53956 2023-07-12 10:55:12,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:12,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x5caf6b04 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:12,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3226ed0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:12,409 DEBUG [hconnection-0x4e2282ec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:12,410 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:12,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5caf6b04 to 127.0.0.1:53956 2023-07-12 10:55:12,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:12,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:55:12,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:55:12,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:12,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:12,422 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:12,423 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689159912423 2023-07-12 10:55:12,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:12,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:12,424 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:55:12,424 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:55:12,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:12,426 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:12,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 10:55:12,432 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:12,433 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689159912433 2023-07-12 10:55:12,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,461 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 10:55:12,461 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:12,463 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 10:55:12,463 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 10:55:12,464 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,464 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,472 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:12,472 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:12,472 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:12,472 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:12,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:12,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:12,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:12,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:12,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:12,473 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,473 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,474 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,474 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:55:12,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 10:55:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,474 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:12,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 10:55:12,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 10:55:12,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:12,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:12,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,480 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:12,480 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:12,482 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:12,482 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:12,482 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:12,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,482 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:12,482 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:12,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,484 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:12,490 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:12,485 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:12,491 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,491 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:12,491 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:12,491 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:12,491 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:12,491 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:12,491 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,492 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:12,493 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,493 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,493 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,493 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:12,493 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,494 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,494 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:12,494 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:12,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:12,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:12,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:12,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 10:55:12,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c5a1973[Count = 1] remaining members to acquire global barrier 2023-07-12 10:55:12,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:12,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:12,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:12,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:12,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:12,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 10:55:12,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c5a1973[Count = 0] remaining members to acquire global barrier 2023-07-12 10:55:12,502 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 10:55:12,502 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,503 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,503 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:12,503 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:12,503 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:55:12,503 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,504 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,504 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,504 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:12,504 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,504 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:55:12,505 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:12,505 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:12,506 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:12,506 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:12,506 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. started... 2023-07-12 10:55:12,506 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:12,506 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:12,506 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:12,517 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:12,518 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:12,519 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 43ba08abbbd4dd829e37f70209ed98eb: 2023-07-12 10:55:12,518 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:12,519 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. started... 2023-07-12 10:55:12,519 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,521 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:12,521 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for faa47ebd737f47ea5139ad41c1f66b88: 2023-07-12 10:55:12,521 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:55:12,521 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,521 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:12,521 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:55:12,525 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:12,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:12,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:12,526 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:55:12,550 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. completed. 2023-07-12 10:55:12,550 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:12,550 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:12,550 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:12,550 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,551 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:12,551 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:55:12,552 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,552 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:12,552 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:12,552 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:12,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:12,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:12,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:12,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:12,556 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. completed. 2023-07-12 10:55:12,556 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:12,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,556 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:12,556 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:12,556 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,556 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:12,556 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:55:12,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:12,559 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,559 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,559 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:12,559 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,35663,1689159209791': 2023-07-12 10:55:12,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 10:55:12,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:12,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:12,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:12,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:12,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:12,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:55:12,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 10:55:12,575 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 10:55:12,575 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:55:12,575 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:55:12,575 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,575 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:55:12,577 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:12,577 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:12,577 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:12,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:12,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:12,578 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:12,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:12,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:12,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:12,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:12,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,580 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,582 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:12,583 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,583 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,590 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:12,590 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:12,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:12,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:12,592 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:12,592 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:12,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:12,592 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:12,592 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,593 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,593 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,594 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:12,594 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:12,594 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:12,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:12,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,594 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:12,594 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,594 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:12,594 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,594 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,594 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,594 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:12,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:12,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:12,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:12,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:12,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,689 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 10:55:12,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,697 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689159312423Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689159312594 (+171 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689159312594Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689159312604 (+10 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689159312625 (+21 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689159312689 (+64 ms) 2023-07-12 10:55:12,703 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:12,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 279 msec 2023-07-12 10:55:12,727 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:12,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:12,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:55:12,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38185] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:55:12,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35663] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:55:12,751 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:12,751 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:12,753 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:12,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:12,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159312781 (current time:1689159312781). 2023-07-12 10:55:12,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:55:12,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x3b591f3e to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:12,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61b6df5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:12,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:12,823 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:12,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b591f3e to 127.0.0.1:53956 2023-07-12 10:55:12,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:12,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x43aae018 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:12,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3079a7bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:12,854 DEBUG [hconnection-0x67e2eaef-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:12,857 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:12,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43aae018 to 127.0.0.1:53956 2023-07-12 10:55:12,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:12,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:55:12,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:55:12,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:12,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:12,866 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:12,867 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689159912867 2023-07-12 10:55:12,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:12,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:12,868 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:55:12,868 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:55:12,870 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:12,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:12,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-12 10:55:12,872 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:12,872 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689159912872 2023-07-12 10:55:12,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,892 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 10:55:12,892 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:12,893 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 10:55:12,893 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 10:55:12,894 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,894 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,895 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:12,895 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:12,895 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:12,895 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:12,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:12,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:12,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:12,896 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,896 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:12,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:12,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,896 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,896 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:55:12,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 10:55:12,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 10:55:12,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:12,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:12,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,898 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:12,898 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:12,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,900 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:12,900 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:12,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 10:55:12,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,902 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:12,902 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:12,902 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:12,902 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:12,902 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:12,902 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:12,902 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:12,903 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,906 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:12,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:12,906 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,906 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:12,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:12,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,906 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:12,907 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:12,911 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:12,912 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:12,912 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,913 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,913 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,913 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,914 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,914 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:12,914 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,914 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:12,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 10:55:12,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bd7be25[Count = 1] remaining members to acquire global barrier 2023-07-12 10:55:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:12,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:12,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:12,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 10:55:12,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bd7be25[Count = 0] remaining members to acquire global barrier 2023-07-12 10:55:12,919 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 10:55:12,919 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,923 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,923 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,923 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,923 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:12,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,924 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:12,924 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,924 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:12,924 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:55:12,924 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:12,925 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:12,925 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:55:12,926 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:12,926 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:12,926 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:12,926 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. started... 2023-07-12 10:55:12,927 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:12,927 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:12,927 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:12,933 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:12,934 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:12,934 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:12,934 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. started... 2023-07-12 10:55:12,934 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 43ba08abbbd4dd829e37f70209ed98eb 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 10:55:12,938 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2745): Flushing faa47ebd737f47ea5139ad41c1f66b88 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 10:55:12,969 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:12,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:12,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:12,971 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:55:12,976 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/.tmp/cf/24fc30fdfbe741e5bd1d4b35526627a6 2023-07-12 10:55:12,977 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/.tmp/cf/2b8a3c212475423a9191f76ae0ed2026 2023-07-12 10:55:12,984 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/.tmp/cf/2b8a3c212475423a9191f76ae0ed2026 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/cf/2b8a3c212475423a9191f76ae0ed2026 2023-07-12 10:55:12,996 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/cf/2b8a3c212475423a9191f76ae0ed2026, entries=3, sequenceid=6, filesize=5.0 K 2023-07-12 10:55:12,997 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 43ba08abbbd4dd829e37f70209ed98eb in 63ms, sequenceid=6, compaction requested=false 2023-07-12 10:55:12,997 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 10:55:12,998 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 43ba08abbbd4dd829e37f70209ed98eb: 2023-07-12 10:55:12,998 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,998 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:12,999 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/cf/2b8a3c212475423a9191f76ae0ed2026] hfiles 2023-07-12 10:55:12,999 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/cf/2b8a3c212475423a9191f76ae0ed2026 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,005 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/.tmp/cf/24fc30fdfbe741e5bd1d4b35526627a6 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/cf/24fc30fdfbe741e5bd1d4b35526627a6 2023-07-12 10:55:13,012 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/cf/24fc30fdfbe741e5bd1d4b35526627a6, entries=47, sequenceid=6, filesize=8 K 2023-07-12 10:55:13,013 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for faa47ebd737f47ea5139ad41c1f66b88 in 87ms, sequenceid=6, compaction requested=false 2023-07-12 10:55:13,016 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for faa47ebd737f47ea5139ad41c1f66b88: 2023-07-12 10:55:13,016 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,018 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:13,019 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/cf/24fc30fdfbe741e5bd1d4b35526627a6] hfiles 2023-07-12 10:55:13,019 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/cf/24fc30fdfbe741e5bd1d4b35526627a6 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,022 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. completed. 2023-07-12 10:55:13,022 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:13,022 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:13,022 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:13,022 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,022 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:13,022 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:55:13,024 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,024 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:13,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:13,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:13,024 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:13,024 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:13,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:13,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:13,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,35663,1689159209791': 2023-07-12 10:55:13,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 10:55:13,052 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. completed. 2023-07-12 10:55:13,052 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:13,052 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:13,052 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:13,052 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,052 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:13,052 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:55:13,054 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,054 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:13,054 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:13,054 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:13,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:13,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:13,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:13,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:55:13,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 10:55:13,067 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 10:55:13,068 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:55:13,068 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:55:13,068 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,068 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:55:13,069 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:13,070 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:13,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:13,070 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:13,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:13,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:13,071 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,072 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:13,073 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,075 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,076 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,077 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,083 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:13,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:13,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:13,083 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:13,083 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:13,083 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:13,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:13,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:13,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:13,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:13,084 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,084 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:13,084 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:13,084 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:13,084 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:13,084 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,087 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,087 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,087 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:13,087 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,087 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:13,087 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:13,087 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,087 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:13,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:13,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,171 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:13,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:13,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:13,172 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:55:13,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 10:55:13,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,183 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689159312867Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689159313087 (+220 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689159313087Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689159313102 (+15 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689159313118 (+16 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689159313181 (+63 ms) 2023-07-12 10:55:13,190 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:13,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 322 msec 2023-07-12 10:55:13,473 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:13,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:13,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:55:13,474 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474 2023-07-12 10:55:13,474 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37511, tgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474, rawTgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474, srcFsUri=hdfs://localhost:37511, srcDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:55:13,498 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:55:13,499 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_916650409_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,499 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7, snapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 10:55:13,505 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:13,559 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,559 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,559 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,560 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,560 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,560 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,560 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,649 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop-8697213030346578363.jar 2023-07-12 10:55:13,649 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,650 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,650 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,650 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,651 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,651 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:13,651 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:55:13,652 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:55:13,652 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:55:13,652 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:55:13,653 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:55:13,653 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:55:13,653 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:55:13,654 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:55:13,654 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:55:13,654 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:55:13,655 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:13,655 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:13,656 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:13,656 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:13,656 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:13,656 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:13,657 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:14,704 WARN [Listener at jenkins-hbase9.apache.org/37221] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:55:14,707 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 10:55:15,182 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:55:15,182 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:55:15,184 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0005_000001 (auth:SIMPLE) 2023-07-12 10:55:15,509 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0006_000001 (auth:SIMPLE) 2023-07-12 10:55:16,638 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:55:22,316 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0006_000001 (auth:SIMPLE) 2023-07-12 10:55:24,935 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:55:24,940 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:55:24,950 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:24,950 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:55:24,951 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:55:24,951 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:24,952 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 10:55:24,952 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 10:55:24,953 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:24,953 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 10:55:24,953 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159313474/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 10:55:24,961 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 10:55:24,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-12 10:55:24,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:24,968 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159324967"}]},"ts":"1689159324967"} 2023-07-12 10:55:24,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 10:55:24,971 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 10:55:24,973 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 10:55:24,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=43ba08abbbd4dd829e37f70209ed98eb, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=faa47ebd737f47ea5139ad41c1f66b88, UNASSIGN}] 2023-07-12 10:55:24,977 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=43ba08abbbd4dd829e37f70209ed98eb, UNASSIGN 2023-07-12 10:55:24,977 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=faa47ebd737f47ea5139ad41c1f66b88, UNASSIGN 2023-07-12 10:55:24,978 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=43ba08abbbd4dd829e37f70209ed98eb, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:24,978 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159324977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159324977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159324977"}]},"ts":"1689159324977"} 2023-07-12 10:55:24,978 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=faa47ebd737f47ea5139ad41c1f66b88, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:24,978 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159324978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159324978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159324978"}]},"ts":"1689159324978"} 2023-07-12 10:55:24,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 43ba08abbbd4dd829e37f70209ed98eb, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:55:24,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure faa47ebd737f47ea5139ad41c1f66b88, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:55:25,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 10:55:25,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:25,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 43ba08abbbd4dd829e37f70209ed98eb, disabling compactions & flushes 2023-07-12 10:55:25,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:25,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:25,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. after waiting 0 ms 2023-07-12 10:55:25,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:25,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:25,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing faa47ebd737f47ea5139ad41c1f66b88, disabling compactions & flushes 2023-07-12 10:55:25,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:25,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:25,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. after waiting 0 ms 2023-07-12 10:55:25,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:25,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:25,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:25,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:25,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:25,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb. 2023-07-12 10:55:25,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88. 2023-07-12 10:55:25,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for faa47ebd737f47ea5139ad41c1f66b88: 2023-07-12 10:55:25,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 43ba08abbbd4dd829e37f70209ed98eb: 2023-07-12 10:55:25,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:25,176 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=43ba08abbbd4dd829e37f70209ed98eb, regionState=CLOSED 2023-07-12 10:55:25,176 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159325176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159325176"}]},"ts":"1689159325176"} 2023-07-12 10:55:25,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:25,177 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=faa47ebd737f47ea5139ad41c1f66b88, regionState=CLOSED 2023-07-12 10:55:25,177 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159325177"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159325177"}]},"ts":"1689159325177"} 2023-07-12 10:55:25,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-12 10:55:25,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 43ba08abbbd4dd829e37f70209ed98eb, server=jenkins-hbase9.apache.org,35663,1689159209791 in 199 msec 2023-07-12 10:55:25,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=43ba08abbbd4dd829e37f70209ed98eb, UNASSIGN in 207 msec 2023-07-12 10:55:25,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-12 10:55:25,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure faa47ebd737f47ea5139ad41c1f66b88, server=jenkins-hbase9.apache.org,38185,1689159209730 in 199 msec 2023-07-12 10:55:25,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-12 10:55:25,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=faa47ebd737f47ea5139ad41c1f66b88, UNASSIGN in 208 msec 2023-07-12 10:55:25,185 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159325185"}]},"ts":"1689159325185"} 2023-07-12 10:55:25,186 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 10:55:25,188 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 10:55:25,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 228 msec 2023-07-12 10:55:25,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 10:55:25,271 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 10:55:25,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,276 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,277 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,279 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,282 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 10:55:25,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 10:55:25,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 10:55:25,283 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:25,283 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:25,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 10:55:25,284 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,284 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:25,284 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,284 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:25,284 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,284 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,284 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:25,284 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:25,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 10:55:25,291 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/recovered.edits] 2023-07-12 10:55:25,291 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/recovered.edits] 2023-07-12 10:55:25,297 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/cf/24fc30fdfbe741e5bd1d4b35526627a6 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/cf/24fc30fdfbe741e5bd1d4b35526627a6 2023-07-12 10:55:25,297 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/cf/2b8a3c212475423a9191f76ae0ed2026 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/cf/2b8a3c212475423a9191f76ae0ed2026 2023-07-12 10:55:25,301 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88/recovered.edits/9.seqid 2023-07-12 10:55:25,301 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb/recovered.edits/9.seqid 2023-07-12 10:55:25,302 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/faa47ebd737f47ea5139ad41c1f66b88 2023-07-12 10:55:25,302 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/43ba08abbbd4dd829e37f70209ed98eb 2023-07-12 10:55:25,302 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 10:55:25,304 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,307 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 10:55:25,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 10:55:25,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 10:55:25,310 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159325310"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:25,310 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159325310"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:25,315 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:55:25,315 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 43ba08abbbd4dd829e37f70209ed98eb, NAME => 'testtb-testEmptyExportFileSystemState,,1689159311750.43ba08abbbd4dd829e37f70209ed98eb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => faa47ebd737f47ea5139ad41c1f66b88, NAME => 'testtb-testEmptyExportFileSystemState,1,1689159311750.faa47ebd737f47ea5139ad41c1f66b88.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:55:25,315 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 10:55:25,315 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159325315"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:25,317 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 10:55:25,320 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:25,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 48 msec 2023-07-12 10:55:25,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 10:55:25,387 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 10:55:25,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 10:55:25,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:25,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 10:55:25,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:25,441 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 762) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:39870 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:37414 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:46685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4831 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x45150b13-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:41769 from appattempt_1689159217572_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1818405067_1 at /127.0.0.1:51430 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:51462 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1818405067_1 at /127.0.0.1:37398 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=689 (was 625) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 182), AvailableMemoryMB=4644 (was 5615) 2023-07-12 10:55:25,441 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-12 10:55:25,471 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=689, ProcessCount=180, AvailableMemoryMB=4643 2023-07-12 10:55:25,472 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-12 10:55:25,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:55:25,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:25,478 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:55:25,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 10:55:25,479 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:55:25,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 10:55:25,483 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:25,483 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:25,485 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110 empty. 2023-07-12 10:55:25,485 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4 empty. 2023-07-12 10:55:25,485 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:25,485 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:25,485 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 10:55:25,524 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 10:55:25,525 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => d5231d0327a4a4e19bf7c6cffda49110, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:55:25,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8685dfab6b00e171e87f468a2ec4bde4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp 2023-07-12 10:55:25,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:25,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 8685dfab6b00e171e87f468a2ec4bde4, disabling compactions & flushes 2023-07-12 10:55:25,564 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:25,564 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:25,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. after waiting 0 ms 2023-07-12 10:55:25,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:25,565 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:25,565 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 8685dfab6b00e171e87f468a2ec4bde4: 2023-07-12 10:55:25,573 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing d5231d0327a4a4e19bf7c6cffda49110, disabling compactions & flushes 2023-07-12 10:55:25,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. after waiting 0 ms 2023-07-12 10:55:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:25,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:25,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for d5231d0327a4a4e19bf7c6cffda49110: 2023-07-12 10:55:25,577 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:55:25,578 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159325578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159325578"}]},"ts":"1689159325578"} 2023-07-12 10:55:25,578 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159325578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159325578"}]},"ts":"1689159325578"} 2023-07-12 10:55:25,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 10:55:25,585 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:55:25,585 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:55:25,586 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159325586"}]},"ts":"1689159325586"} 2023-07-12 10:55:25,587 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 10:55:25,593 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:55:25,594 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:55:25,594 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:55:25,595 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:55:25,595 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:55:25,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5231d0327a4a4e19bf7c6cffda49110, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8685dfab6b00e171e87f468a2ec4bde4, ASSIGN}] 2023-07-12 10:55:25,598 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8685dfab6b00e171e87f468a2ec4bde4, ASSIGN 2023-07-12 10:55:25,598 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5231d0327a4a4e19bf7c6cffda49110, ASSIGN 2023-07-12 10:55:25,600 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5231d0327a4a4e19bf7c6cffda49110, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38185,1689159209730; forceNewPlan=false, retain=false 2023-07-12 10:55:25,600 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8685dfab6b00e171e87f468a2ec4bde4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35663,1689159209791; forceNewPlan=false, retain=false 2023-07-12 10:55:25,750 INFO [jenkins-hbase9:44397] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:55:25,755 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d5231d0327a4a4e19bf7c6cffda49110, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:25,755 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8685dfab6b00e171e87f468a2ec4bde4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:25,755 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159325755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159325755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159325755"}]},"ts":"1689159325755"} 2023-07-12 10:55:25,755 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159325755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159325755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159325755"}]},"ts":"1689159325755"} 2023-07-12 10:55:25,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure d5231d0327a4a4e19bf7c6cffda49110, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:55:25,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 8685dfab6b00e171e87f468a2ec4bde4, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:55:25,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 10:55:25,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:25,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5231d0327a4a4e19bf7c6cffda49110, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:55:25,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. service=AccessControlService 2023-07-12 10:55:25,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:55:25,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:25,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:25,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:25,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:25,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:25,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8685dfab6b00e171e87f468a2ec4bde4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:55:25,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. service=AccessControlService 2023-07-12 10:55:25,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:55:25,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:25,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:25,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:25,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:25,922 INFO [StoreOpener-d5231d0327a4a4e19bf7c6cffda49110-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:25,922 INFO [StoreOpener-8685dfab6b00e171e87f468a2ec4bde4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:25,924 DEBUG [StoreOpener-8685dfab6b00e171e87f468a2ec4bde4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/cf 2023-07-12 10:55:25,924 DEBUG [StoreOpener-8685dfab6b00e171e87f468a2ec4bde4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/cf 2023-07-12 10:55:25,925 INFO [StoreOpener-8685dfab6b00e171e87f468a2ec4bde4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8685dfab6b00e171e87f468a2ec4bde4 columnFamilyName cf 2023-07-12 10:55:25,926 INFO [StoreOpener-8685dfab6b00e171e87f468a2ec4bde4-1] regionserver.HStore(310): Store=8685dfab6b00e171e87f468a2ec4bde4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:55:25,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:25,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:25,929 DEBUG [StoreOpener-d5231d0327a4a4e19bf7c6cffda49110-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/cf 2023-07-12 10:55:25,929 DEBUG [StoreOpener-d5231d0327a4a4e19bf7c6cffda49110-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/cf 2023-07-12 10:55:25,930 INFO [StoreOpener-d5231d0327a4a4e19bf7c6cffda49110-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5231d0327a4a4e19bf7c6cffda49110 columnFamilyName cf 2023-07-12 10:55:25,934 INFO [StoreOpener-d5231d0327a4a4e19bf7c6cffda49110-1] regionserver.HStore(310): Store=d5231d0327a4a4e19bf7c6cffda49110/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:55:25,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:25,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:25,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:25,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:55:25,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8685dfab6b00e171e87f468a2ec4bde4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72699765, jitterRate=0.08331091701984406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:55:25,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8685dfab6b00e171e87f468a2ec4bde4: 2023-07-12 10:55:25,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4., pid=109, masterSystemTime=1689159325910 2023-07-12 10:55:25,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:25,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:25,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:25,941 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8685dfab6b00e171e87f468a2ec4bde4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:25,942 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159325941"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159325941"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159325941"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159325941"}]},"ts":"1689159325941"} 2023-07-12 10:55:25,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:55:25,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d5231d0327a4a4e19bf7c6cffda49110; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61168068, jitterRate=-0.08852475881576538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:55:25,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d5231d0327a4a4e19bf7c6cffda49110: 2023-07-12 10:55:25,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110., pid=108, masterSystemTime=1689159325909 2023-07-12 10:55:25,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-12 10:55:25,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 8685dfab6b00e171e87f468a2ec4bde4, server=jenkins-hbase9.apache.org,35663,1689159209791 in 185 msec 2023-07-12 10:55:25,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:25,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:25,947 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d5231d0327a4a4e19bf7c6cffda49110, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:25,947 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159325947"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159325947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159325947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159325947"}]},"ts":"1689159325947"} 2023-07-12 10:55:25,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8685dfab6b00e171e87f468a2ec4bde4, ASSIGN in 351 msec 2023-07-12 10:55:25,951 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-12 10:55:25,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure d5231d0327a4a4e19bf7c6cffda49110, server=jenkins-hbase9.apache.org,38185,1689159209730 in 192 msec 2023-07-12 10:55:25,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-12 10:55:25,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5231d0327a4a4e19bf7c6cffda49110, ASSIGN in 357 msec 2023-07-12 10:55:25,958 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:55:25,958 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159325958"}]},"ts":"1689159325958"} 2023-07-12 10:55:25,962 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 10:55:25,967 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:55:25,967 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 10:55:25,970 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 10:55:25,971 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:25,971 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:25,972 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:25,972 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:25,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:25,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:25,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:25,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:25,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 499 msec 2023-07-12 10:55:26,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 10:55:26,087 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 10:55:26,087 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-12 10:55:26,087 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:26,091 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-12 10:55:26,091 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:26,091 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-12 10:55:26,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:26,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159326094 (current time:1689159326094). 2023-07-12 10:55:26,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:55:26,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x050a3f56 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:26,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@94d498f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:26,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:26,104 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:26,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x050a3f56 to 127.0.0.1:53956 2023-07-12 10:55:26,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:26,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x7c003819 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:26,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28244840, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:26,129 DEBUG [hconnection-0x4b466dfa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:26,132 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:26,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c003819 to 127.0.0.1:53956 2023-07-12 10:55:26,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:26,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 10:55:26,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:55:26,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:26,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:26,146 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:26,147 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689159926147 2023-07-12 10:55:26,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:26,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,149 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:55:26,149 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:55:26,150 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:26,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:26,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-12 10:55:26,159 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:26,160 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689159926160 2023-07-12 10:55:26,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,200 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 10:55:26,200 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:26,204 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 10:55:26,204 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 10:55:26,205 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,205 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,206 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:26,206 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:26,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:26,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:26,206 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:26,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:26,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:26,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:26,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:26,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,206 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 10:55:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 10:55:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,211 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:26,211 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:26,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,212 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,212 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 10:55:26,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,212 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,212 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:55:26,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:26,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,213 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:26,214 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:26,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,218 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:26,218 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:26,219 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:26,221 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:26,221 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:26,218 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:26,221 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:26,221 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:26,221 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:26,221 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:26,224 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:26,224 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:26,224 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:26,229 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,229 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:26,230 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,230 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,230 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,230 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:26,232 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:26,232 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,232 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:26,232 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,233 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:26,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 10:55:26,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b45da41[Count = 1] remaining members to acquire global barrier 2023-07-12 10:55:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:26,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 10:55:26,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b45da41[Count = 0] remaining members to acquire global barrier 2023-07-12 10:55:26,237 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 10:55:26,237 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,238 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,238 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,238 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,239 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:26,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,239 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,239 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:26,239 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:26,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,239 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,239 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. started... 2023-07-12 10:55:26,239 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:26,239 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:26,239 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,239 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:26,241 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5231d0327a4a4e19bf7c6cffda49110: 2023-07-12 10:55:26,239 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:55:26,239 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:55:26,243 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,243 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:26,243 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:55:26,247 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:26,247 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:26,247 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:26,249 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:26,249 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:26,250 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:26,253 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:26,253 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. started... 2023-07-12 10:55:26,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:26,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:26,254 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:55:26,256 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8685dfab6b00e171e87f468a2ec4bde4: 2023-07-12 10:55:26,256 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,256 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:26,256 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:55:26,263 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 10:55:26,331 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. completed. 2023-07-12 10:55:26,331 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:26,331 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:26,332 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:26,332 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,332 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:26,332 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:55:26,333 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:26,333 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,333 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:26,334 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:26,336 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. completed. 2023-07-12 10:55:26,336 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:26,336 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:26,336 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:26,336 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:26,336 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:26,336 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:55:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,339 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:26,339 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,339 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:26,339 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:55:26,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 10:55:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,35663,1689159209791': 2023-07-12 10:55:26,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 10:55:26,347 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 10:55:26,347 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:55:26,347 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:55:26,347 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,347 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:55:26,349 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,349 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,349 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:26,349 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,350 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:26,350 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,350 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,350 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:26,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:26,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:26,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:26,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:26,351 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:26,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:26,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:26,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,351 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:26,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,354 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:26,354 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,355 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,358 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:26,359 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:26,359 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:26,359 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:26,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:26,359 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:26,359 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:26,359 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:26,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:26,359 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:26,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:26,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:26,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:26,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,361 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,361 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:26,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:26,361 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,361 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:26,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:26,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:26,361 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:26,362 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:26,362 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:26,362 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:26,362 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,362 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,454 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:26,455 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:55:26,756 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:26,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:26,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:26,757 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 10:55:26,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 10:55:26,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,834 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:26,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689159326147Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689159326361 (+214 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689159326361Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689159326365 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689159326797 (+432 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689159326833 (+36 ms) 2023-07-12 10:55:26,839 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:26,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 690 msec 2023-07-12 10:55:27,257 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:27,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:27,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:55:27,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38185] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:55:27,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35663] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:55:27,268 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,268 DEBUG [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:27,268 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:27,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:27,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159327277 (current time:1689159327277). 2023-07-12 10:55:27,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:55:27,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x42b75d85 to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:27,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a66d194, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:27,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:27,292 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:27,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42b75d85 to 127.0.0.1:53956 2023-07-12 10:55:27,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:27,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(139): Connect 0x5a38fabe to 127.0.0.1:53956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:27,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bfe6c5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:27,401 DEBUG [hconnection-0x2f42b1b4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:27,402 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:27,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a38fabe to 127.0.0.1:53956 2023-07-12 10:55:27,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:27,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 10:55:27,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:55:27,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:27,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:27,413 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:27,414 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689159927414 2023-07-12 10:55:27,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:27,414 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,415 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:55:27,416 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:55:27,419 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:27,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:27,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-12 10:55:27,421 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:27,422 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689159927422 2023-07-12 10:55:27,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,433 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 10:55:27,433 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:27,435 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 10:55:27,435 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 10:55:27,435 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,435 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,436 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:27,436 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:27,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:27,436 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:27,436 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:27,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:27,437 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,437 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,437 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,437 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:55:27,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,439 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:27,439 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:27,439 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:27,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,439 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:27,441 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:27,442 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:27,441 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:27,443 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:27,443 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:27,442 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:27,443 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:27,443 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44589,1689159209836' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:27,443 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:27,443 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:27,443 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:27,445 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,445 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,446 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,446 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:27,446 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:27,446 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:27,446 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,446 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,446 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:27,446 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,447 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:27,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:27,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:27,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35663,1689159209791' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 10:55:27,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bcc1211[Count = 1] remaining members to acquire global barrier 2023-07-12 10:55:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:27,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38185,1689159209730' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 10:55:27,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bcc1211[Count = 0] remaining members to acquire global barrier 2023-07-12 10:55:27,452 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 10:55:27,452 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:27,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,458 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:27,458 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:27,458 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:27,458 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:27,459 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,459 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:55:27,459 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:27,459 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:27,459 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:27,459 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:27,459 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. started... 2023-07-12 10:55:27,458 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:27,459 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44589,1689159209836' in zk 2023-07-12 10:55:27,459 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. started... 2023-07-12 10:55:27,459 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8685dfab6b00e171e87f468a2ec4bde4 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-12 10:55:27,459 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d5231d0327a4a4e19bf7c6cffda49110 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-12 10:55:27,461 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:27,461 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:27,461 DEBUG [member: 'jenkins-hbase9.apache.org,44589,1689159209836' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:27,480 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/.tmp/cf/bb3b57817a98450696734c7e3a263833 2023-07-12 10:55:27,486 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/.tmp/cf/bb3b57817a98450696734c7e3a263833 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/cf/bb3b57817a98450696734c7e3a263833 2023-07-12 10:55:27,491 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/cf/bb3b57817a98450696734c7e3a263833, entries=6, sequenceid=6, filesize=5.2 K 2023-07-12 10:55:27,492 INFO [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for d5231d0327a4a4e19bf7c6cffda49110 in 33ms, sequenceid=6, compaction requested=false 2023-07-12 10:55:27,494 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5231d0327a4a4e19bf7c6cffda49110: 2023-07-12 10:55:27,494 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,495 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:27,495 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/cf/bb3b57817a98450696734c7e3a263833] hfiles 2023-07-12 10:55:27,495 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/cf/bb3b57817a98450696734c7e3a263833 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,516 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:27,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:27,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:27,517 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:55:27,538 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. completed. 2023-07-12 10:55:27,538 DEBUG [rs(jenkins-hbase9.apache.org,38185,1689159209730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:27,538 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:27,538 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:27,538 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,538 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:27,538 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,38185,1689159209730' in zk 2023-07-12 10:55:27,540 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,540 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:27,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,540 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:27,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:27,540 DEBUG [member: 'jenkins-hbase9.apache.org,38185,1689159209730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:27,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:27,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:27,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:27,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,38185,1689159209730': 2023-07-12 10:55:27,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38185,1689159209730' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 10:55:27,717 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:27,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:27,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:27,719 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:55:27,881 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/.tmp/cf/c0459ad3a9f54008bf7e62c483aa2fb4 2023-07-12 10:55:27,887 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/.tmp/cf/c0459ad3a9f54008bf7e62c483aa2fb4 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/cf/c0459ad3a9f54008bf7e62c483aa2fb4 2023-07-12 10:55:27,897 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/cf/c0459ad3a9f54008bf7e62c483aa2fb4, entries=44, sequenceid=6, filesize=7.8 K 2023-07-12 10:55:27,898 INFO [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 8685dfab6b00e171e87f468a2ec4bde4 in 439ms, sequenceid=6, compaction requested=false 2023-07-12 10:55:27,898 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8685dfab6b00e171e87f468a2ec4bde4: 2023-07-12 10:55:27,898 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,898 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:27,898 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/cf/c0459ad3a9f54008bf7e62c483aa2fb4] hfiles 2023-07-12 10:55:27,898 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/cf/c0459ad3a9f54008bf7e62c483aa2fb4 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,908 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. completed. 2023-07-12 10:55:27,908 DEBUG [rs(jenkins-hbase9.apache.org,35663,1689159209791)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:27,908 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:27,908 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:27,908 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,908 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:27,908 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35663,1689159209791' in zk 2023-07-12 10:55:27,911 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,911 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:27,911 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:27,911 DEBUG [member: 'jenkins-hbase9.apache.org,35663,1689159209791' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,35663,1689159209791': 2023-07-12 10:55:27,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35663,1689159209791' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 10:55:27,916 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 10:55:27,916 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:55:27,916 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:55:27,916 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,916 INFO [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:55:27,918 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,918 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,918 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:27,918 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:27,918 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,918 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:27,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,918 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,919 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:27,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:27,919 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,919 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,921 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:27,922 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,922 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:27,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:27,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:27,925 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:27,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,925 DEBUG [(jenkins-hbase9.apache.org,44397,1689159208192)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:27,926 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,926 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:27,926 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:55:27,926 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,926 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:27,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:27,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:27,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:27,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:27,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:27,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 10:55:27,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,980 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:27,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689159327414Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689159327925 (+511 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689159327926 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689159327936 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689159327946 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689159327979 (+33 ms) 2023-07-12 10:55:27,983 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:27,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 568 msec 2023-07-12 10:55:28,019 DEBUG [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:28,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:28,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:55:28,020 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020 2023-07-12 10:55:28,020 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37511, tgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020, rawTgtDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020, srcFsUri=hdfs://localhost:37511, srcDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:55:28,044 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7 2023-07-12 10:55:28,044 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1978182911_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:28,044 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37511, inputRoot=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7, snapshotDir=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 10:55:28,057 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:28,076 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,077 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,077 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,077 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,078 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,078 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,078 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,166 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/hadoop-6763464879079186347.jar 2023-07-12 10:55:28,167 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,167 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,168 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,168 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,169 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,169 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:28,170 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:55:28,170 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:55:28,171 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:55:28,171 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:55:28,172 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:55:28,172 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:55:28,173 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:55:28,173 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:55:28,173 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:55:28,174 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:55:28,174 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:28,175 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:28,175 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:28,175 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:28,176 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:28,176 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:28,176 DEBUG [Listener at jenkins-hbase9.apache.org/37221] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:28,725 WARN [Listener at jenkins-hbase9.apache.org/37221] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:55:28,730 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 10:55:28,732 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 10:55:29,811 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:55:29,811 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:55:29,814 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0006_000001 (auth:SIMPLE) 2023-07-12 10:55:30,195 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0007_000001 (auth:SIMPLE) 2023-07-12 10:55:30,828 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:55:35,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0007_000001 (auth:SIMPLE) 2023-07-12 10:55:38,209 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0007_000001 (auth:SIMPLE) 2023-07-12 10:55:41,635 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217572_0007_000001 (auth:SIMPLE) 2023-07-12 10:55:42,923 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:55:42,923 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:55:42,936 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:42,936 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:55:42,936 INFO [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:55:42,937 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:42,937 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 10:55:42,937 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 10:55:42,937 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-781996977_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:42,938 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 10:55:42,938 DEBUG [Listener at jenkins-hbase9.apache.org/37221] snapshot.TestExportSnapshot(367): hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/export-test/export-1689159328020/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 10:55:42,943 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:42,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:42,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:42,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 10:55:42,946 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159342946"}]},"ts":"1689159342946"} 2023-07-12 10:55:42,948 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 10:55:42,949 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 10:55:42,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5231d0327a4a4e19bf7c6cffda49110, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8685dfab6b00e171e87f468a2ec4bde4, UNASSIGN}] 2023-07-12 10:55:42,951 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5231d0327a4a4e19bf7c6cffda49110, UNASSIGN 2023-07-12 10:55:42,951 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8685dfab6b00e171e87f468a2ec4bde4, UNASSIGN 2023-07-12 10:55:42,952 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d5231d0327a4a4e19bf7c6cffda49110, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:55:42,952 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8685dfab6b00e171e87f468a2ec4bde4, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:55:42,952 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159342951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159342951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159342951"}]},"ts":"1689159342951"} 2023-07-12 10:55:42,952 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159342952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159342952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159342952"}]},"ts":"1689159342952"} 2023-07-12 10:55:42,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure d5231d0327a4a4e19bf7c6cffda49110, server=jenkins-hbase9.apache.org,38185,1689159209730}] 2023-07-12 10:55:42,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 8685dfab6b00e171e87f468a2ec4bde4, server=jenkins-hbase9.apache.org,35663,1689159209791}] 2023-07-12 10:55:43,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 10:55:43,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:43,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8685dfab6b00e171e87f468a2ec4bde4, disabling compactions & flushes 2023-07-12 10:55:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d5231d0327a4a4e19bf7c6cffda49110, disabling compactions & flushes 2023-07-12 10:55:43,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:43,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. after waiting 0 ms 2023-07-12 10:55:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. after waiting 0 ms 2023-07-12 10:55:43,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:43,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:43,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:43,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:43,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:43,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4. 2023-07-12 10:55:43,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8685dfab6b00e171e87f468a2ec4bde4: 2023-07-12 10:55:43,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110. 2023-07-12 10:55:43,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d5231d0327a4a4e19bf7c6cffda49110: 2023-07-12 10:55:43,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:43,130 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8685dfab6b00e171e87f468a2ec4bde4, regionState=CLOSED 2023-07-12 10:55:43,131 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159343130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159343130"}]},"ts":"1689159343130"} 2023-07-12 10:55:43,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:43,132 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d5231d0327a4a4e19bf7c6cffda49110, regionState=CLOSED 2023-07-12 10:55:43,132 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159343132"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159343132"}]},"ts":"1689159343132"} 2023-07-12 10:55:43,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-12 10:55:43,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 8685dfab6b00e171e87f468a2ec4bde4, server=jenkins-hbase9.apache.org,35663,1689159209791 in 179 msec 2023-07-12 10:55:43,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-12 10:55:43,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure d5231d0327a4a4e19bf7c6cffda49110, server=jenkins-hbase9.apache.org,38185,1689159209730 in 180 msec 2023-07-12 10:55:43,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8685dfab6b00e171e87f468a2ec4bde4, UNASSIGN in 184 msec 2023-07-12 10:55:43,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-12 10:55:43,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d5231d0327a4a4e19bf7c6cffda49110, UNASSIGN in 185 msec 2023-07-12 10:55:43,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159343137"}]},"ts":"1689159343137"} 2023-07-12 10:55:43,139 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 10:55:43,140 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 10:55:43,143 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 198 msec 2023-07-12 10:55:43,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 10:55:43,249 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 10:55:43,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,253 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,255 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35663] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,256 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,259 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,259 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,259 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,259 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 10:55:43,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 10:55:43,261 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,261 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,261 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:43,261 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:43,262 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:43,262 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:43,262 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-12 10:55:43,262 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-12 10:55:43,262 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 10:55:43,262 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 10:55:43,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 10:55:43,266 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:43,269 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:43,271 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/recovered.edits] 2023-07-12 10:55:43,272 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/cf, FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/recovered.edits] 2023-07-12 10:55:43,276 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/cf/c0459ad3a9f54008bf7e62c483aa2fb4 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/cf/c0459ad3a9f54008bf7e62c483aa2fb4 2023-07-12 10:55:43,277 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/cf/bb3b57817a98450696734c7e3a263833 to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/cf/bb3b57817a98450696734c7e3a263833 2023-07-12 10:55:43,280 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4/recovered.edits/9.seqid 2023-07-12 10:55:43,280 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/recovered.edits/9.seqid to hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110/recovered.edits/9.seqid 2023-07-12 10:55:43,280 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8685dfab6b00e171e87f468a2ec4bde4 2023-07-12 10:55:43,280 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d5231d0327a4a4e19bf7c6cffda49110 2023-07-12 10:55:43,281 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 10:55:43,283 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,287 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 10:55:43,291 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 10:55:43,292 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,292 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 10:55:43,293 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159343292"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:43,293 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159343292"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:43,301 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:55:43,302 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d5231d0327a4a4e19bf7c6cffda49110, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689159325473.d5231d0327a4a4e19bf7c6cffda49110.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8685dfab6b00e171e87f468a2ec4bde4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159325473.8685dfab6b00e171e87f468a2ec4bde4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:55:43,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 10:55:43,302 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159343302"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:43,304 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 10:55:43,306 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 56 msec 2023-07-12 10:55:43,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 10:55:43,364 INFO [Listener at jenkins-hbase9.apache.org/37221] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 10:55:43,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 10:55:43,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 10:55:43,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44397] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:43,408 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 765) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5440 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x45150b13-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:44285 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x45150b13-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_821671218_1 at /127.0.0.1:41152 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_821671218_1 at /127.0.0.1:43564 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:43584 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:35964 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-781996977_17 at /127.0.0.1:41166 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=898 (was 909), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=644 (was 689), ProcessCount=180 (was 180), AvailableMemoryMB=4845 (was 4643) - AvailableMemoryMB LEAK? - 2023-07-12 10:55:43,408 WARN [Listener at jenkins-hbase9.apache.org/37221] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-12 10:55:43,408 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 10:55:43,421 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-12 10:55:43,533 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689159217572_0007_01_000001 is : 143 2023-07-12 10:55:48,728 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:55:57,542 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-12 10:56:11,671 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 10:56:11,672 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-12 10:56:11,795 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 10:56:11,813 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 10:56:11,815 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 10:56:11,825 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-12 10:56:11,930 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 10:56:11,930 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 10:56:11,930 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 10:56:11,931 INFO [Listener at jenkins-hbase9.apache.org/37221] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 10:56:11,931 DEBUG [Listener at jenkins-hbase9.apache.org/37221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x504158e6 to 127.0.0.1:53956 2023-07-12 10:56:11,931 DEBUG [Listener at jenkins-hbase9.apache.org/37221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:11,931 DEBUG [Listener at jenkins-hbase9.apache.org/37221] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 10:56:11,931 DEBUG [Listener at jenkins-hbase9.apache.org/37221] util.JVMClusterUtil(257): Found active master hash=727074255, stopped=false 2023-07-12 10:56:11,931 DEBUG [Listener at jenkins-hbase9.apache.org/37221] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:11,932 DEBUG [Listener at jenkins-hbase9.apache.org/37221] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 10:56:11,932 INFO [Listener at jenkins-hbase9.apache.org/37221] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:56:11,933 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 10:56:11,933 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 10:56:11,933 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 10:56:11,933 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 10:56:11,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:56:11,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:56:11,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:56:11,938 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:56:11,938 INFO [Listener at jenkins-hbase9.apache.org/37221] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 10:56:11,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:56:11,938 DEBUG [Listener at jenkins-hbase9.apache.org/37221] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x382df8ad to 127.0.0.1:53956 2023-07-12 10:56:11,938 DEBUG [Listener at jenkins-hbase9.apache.org/37221] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:11,938 INFO [Listener at jenkins-hbase9.apache.org/37221] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,38185,1689159209730' ***** 2023-07-12 10:56:11,939 DEBUG [Listener at jenkins-hbase9.apache.org/37221] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:11,939 INFO [Listener at jenkins-hbase9.apache.org/37221] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 10:56:11,939 INFO [Listener at jenkins-hbase9.apache.org/37221] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,35663,1689159209791' ***** 2023-07-12 10:56:11,939 DEBUG [Listener at jenkins-hbase9.apache.org/37221] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:11,939 INFO [Listener at jenkins-hbase9.apache.org/37221] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 10:56:11,939 INFO [Listener at jenkins-hbase9.apache.org/37221] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,44589,1689159209836' ***** 2023-07-12 10:56:11,939 INFO [RS:0;jenkins-hbase9:38185] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 10:56:11,939 INFO [RS:1;jenkins-hbase9:35663] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 10:56:11,939 DEBUG [Listener at jenkins-hbase9.apache.org/37221] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:11,939 INFO [Listener at jenkins-hbase9.apache.org/37221] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 10:56:11,939 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 10:56:11,940 INFO [RS:0;jenkins-hbase9:38185] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 10:56:11,939 INFO [RS:1;jenkins-hbase9:35663] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 10:56:11,940 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 10:56:11,940 INFO [RS:2;jenkins-hbase9:44589] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 10:56:11,940 INFO [RS:1;jenkins-hbase9:35663] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 10:56:11,940 INFO [RS:0;jenkins-hbase9:38185] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 10:56:11,940 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 10:56:11,940 INFO [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:56:11,940 DEBUG [RS:0;jenkins-hbase9:38185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f8e3899 to 127.0.0.1:53956 2023-07-12 10:56:11,940 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(3305): Received CLOSE for a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:56:11,940 INFO [RS:2;jenkins-hbase9:44589] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 10:56:11,940 DEBUG [RS:0;jenkins-hbase9:38185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:11,940 INFO [RS:2;jenkins-hbase9:44589] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 10:56:11,941 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:56:11,941 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(3305): Received CLOSE for af740a46e6612614c6a9803efa051fe0 2023-07-12 10:56:11,941 DEBUG [RS:1;jenkins-hbase9:35663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a04c89f to 127.0.0.1:53956 2023-07-12 10:56:11,941 DEBUG [RS:1;jenkins-hbase9:35663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:11,941 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:56:11,941 DEBUG [RS:2;jenkins-hbase9:44589] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5507dc1d to 127.0.0.1:53956 2023-07-12 10:56:11,941 DEBUG [RS:2;jenkins-hbase9:44589] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:11,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a9e5eb70b4f0cd1cb790220b33a5d27c, disabling compactions & flushes 2023-07-12 10:56:11,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing af740a46e6612614c6a9803efa051fe0, disabling compactions & flushes 2023-07-12 10:56:11,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:56:11,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:56:11,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:56:11,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. after waiting 0 ms 2023-07-12 10:56:11,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:56:11,947 INFO [RS:1;jenkins-hbase9:35663] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 10:56:11,947 INFO [RS:1;jenkins-hbase9:35663] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 10:56:11,947 INFO [RS:1;jenkins-hbase9:35663] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 10:56:11,947 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:11,947 INFO [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,38185,1689159209730; all regions closed. 2023-07-12 10:56:11,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:56:11,947 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 10:56:11,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing a9e5eb70b4f0cd1cb790220b33a5d27c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 10:56:11,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. after waiting 0 ms 2023-07-12 10:56:11,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:56:11,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing af740a46e6612614c6a9803efa051fe0 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 10:56:11,948 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-12 10:56:11,948 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, a9e5eb70b4f0cd1cb790220b33a5d27c=hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c.} 2023-07-12 10:56:11,947 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 10:56:11,948 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1478): Online Regions={af740a46e6612614c6a9803efa051fe0=hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0.} 2023-07-12 10:56:11,949 DEBUG [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1504): Waiting on af740a46e6612614c6a9803efa051fe0 2023-07-12 10:56:11,949 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1504): Waiting on 1588230740, a9e5eb70b4f0cd1cb790220b33a5d27c 2023-07-12 10:56:11,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 10:56:11,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 10:56:11,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 10:56:11,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 10:56:11,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 10:56:11,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 10:56:11,998 DEBUG [RS:0;jenkins-hbase9:38185] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/oldWALs 2023-07-12 10:56:11,998 INFO [RS:0;jenkins-hbase9:38185] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C38185%2C1689159209730:(num 1689159212042) 2023-07-12 10:56:11,998 DEBUG [RS:0;jenkins-hbase9:38185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:11,998 INFO [RS:0;jenkins-hbase9:38185] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:12,010 INFO [RS:0;jenkins-hbase9:38185] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 10:56:12,012 INFO [RS:0;jenkins-hbase9:38185] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 10:56:12,012 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 10:56:12,012 INFO [RS:0;jenkins-hbase9:38185] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 10:56:12,012 INFO [RS:0;jenkins-hbase9:38185] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 10:56:12,022 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:12,027 INFO [RS:0;jenkins-hbase9:38185] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:38185 2023-07-12 10:56:12,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0/.tmp/info/51c9ea5494c542faafbd1f357286a7fe 2023-07-12 10:56:12,029 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:12,034 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/.tmp/info/69e46f2a6cd64273b6375d703b85fe5a 2023-07-12 10:56:12,038 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:56:12,038 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:56:12,039 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:12,038 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38185,1689159209730 2023-07-12 10:56:12,039 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:12,039 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:12,039 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:12,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c/.tmp/l/f6b1ff2901b5455f947d7a843bb00139 2023-07-12 10:56:12,057 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,38185,1689159209730] 2023-07-12 10:56:12,058 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,38185,1689159209730; numProcessing=1 2023-07-12 10:56:12,059 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69e46f2a6cd64273b6375d703b85fe5a 2023-07-12 10:56:12,060 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,38185,1689159209730 already deleted, retry=false 2023-07-12 10:56:12,061 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,38185,1689159209730 expired; onlineServers=2 2023-07-12 10:56:12,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0/.tmp/info/51c9ea5494c542faafbd1f357286a7fe as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0/info/51c9ea5494c542faafbd1f357286a7fe 2023-07-12 10:56:12,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6b1ff2901b5455f947d7a843bb00139 2023-07-12 10:56:12,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c/.tmp/l/f6b1ff2901b5455f947d7a843bb00139 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c/l/f6b1ff2901b5455f947d7a843bb00139 2023-07-12 10:56:12,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0/info/51c9ea5494c542faafbd1f357286a7fe, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 10:56:12,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for af740a46e6612614c6a9803efa051fe0 in 122ms, sequenceid=6, compaction requested=false 2023-07-12 10:56:12,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6b1ff2901b5455f947d7a843bb00139 2023-07-12 10:56:12,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c/l/f6b1ff2901b5455f947d7a843bb00139, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 10:56:12,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for a9e5eb70b4f0cd1cb790220b33a5d27c in 125ms, sequenceid=18, compaction requested=false 2023-07-12 10:56:12,122 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/.tmp/rep_barrier/a2ed577122664c2ca2f80848922095e2 2023-07-12 10:56:12,128 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2ed577122664c2ca2f80848922095e2 2023-07-12 10:56:12,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/acl/a9e5eb70b4f0cd1cb790220b33a5d27c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 10:56:12,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:12,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:56:12,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a9e5eb70b4f0cd1cb790220b33a5d27c: 2023-07-12 10:56:12,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689159213468.a9e5eb70b4f0cd1cb790220b33a5d27c. 2023-07-12 10:56:12,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/namespace/af740a46e6612614c6a9803efa051fe0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:56:12,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:12,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:56:12,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for af740a46e6612614c6a9803efa051fe0: 2023-07-12 10:56:12,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689159212597.af740a46e6612614c6a9803efa051fe0. 2023-07-12 10:56:12,149 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,44589,1689159209836; all regions closed. 2023-07-12 10:56:12,149 DEBUG [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 10:56:12,162 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:12,162 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:38185-0x101591ccd120001, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:12,162 INFO [RS:0;jenkins-hbase9:38185] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,38185,1689159209730; zookeeper connection closed. 2023-07-12 10:56:12,174 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1071de0b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1071de0b 2023-07-12 10:56:12,182 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/.tmp/table/14093b9926ba42c69fe7a879967f046c 2023-07-12 10:56:12,189 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14093b9926ba42c69fe7a879967f046c 2023-07-12 10:56:12,190 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/.tmp/info/69e46f2a6cd64273b6375d703b85fe5a as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/info/69e46f2a6cd64273b6375d703b85fe5a 2023-07-12 10:56:12,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69e46f2a6cd64273b6375d703b85fe5a 2023-07-12 10:56:12,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/info/69e46f2a6cd64273b6375d703b85fe5a, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 10:56:12,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/.tmp/rep_barrier/a2ed577122664c2ca2f80848922095e2 as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/rep_barrier/a2ed577122664c2ca2f80848922095e2 2023-07-12 10:56:12,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2ed577122664c2ca2f80848922095e2 2023-07-12 10:56:12,203 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/rep_barrier/a2ed577122664c2ca2f80848922095e2, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 10:56:12,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/.tmp/table/14093b9926ba42c69fe7a879967f046c as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/table/14093b9926ba42c69fe7a879967f046c 2023-07-12 10:56:12,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14093b9926ba42c69fe7a879967f046c 2023-07-12 10:56:12,228 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/table/14093b9926ba42c69fe7a879967f046c, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 10:56:12,229 DEBUG [RS:2;jenkins-hbase9:44589] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/oldWALs 2023-07-12 10:56:12,229 INFO [RS:2;jenkins-hbase9:44589] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44589%2C1689159209836:(num 1689159212050) 2023-07-12 10:56:12,229 DEBUG [RS:2;jenkins-hbase9:44589] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:12,229 INFO [RS:2;jenkins-hbase9:44589] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:12,229 INFO [RS:2;jenkins-hbase9:44589] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 10:56:12,230 INFO [RS:2;jenkins-hbase9:44589] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 10:56:12,230 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 10:56:12,230 INFO [RS:2;jenkins-hbase9:44589] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 10:56:12,230 INFO [RS:2;jenkins-hbase9:44589] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 10:56:12,231 INFO [RS:2;jenkins-hbase9:44589] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44589 2023-07-12 10:56:12,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 286ms, sequenceid=131, compaction requested=false 2023-07-12 10:56:12,237 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:56:12,237 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:12,237 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44589,1689159209836 2023-07-12 10:56:12,238 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,44589,1689159209836] 2023-07-12 10:56:12,238 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,44589,1689159209836; numProcessing=2 2023-07-12 10:56:12,239 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,44589,1689159209836 already deleted, retry=false 2023-07-12 10:56:12,239 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,44589,1689159209836 expired; onlineServers=1 2023-07-12 10:56:12,274 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 10:56:12,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:12,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 10:56:12,276 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 10:56:12,276 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 10:56:12,277 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 10:56:12,344 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:12,344 INFO [RS:2;jenkins-hbase9:44589] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,44589,1689159209836; zookeeper connection closed. 2023-07-12 10:56:12,344 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:44589-0x101591ccd120003, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:12,344 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1edddd59] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1edddd59 2023-07-12 10:56:12,349 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,35663,1689159209791; all regions closed. 2023-07-12 10:56:12,359 DEBUG [RS:1;jenkins-hbase9:35663] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/oldWALs 2023-07-12 10:56:12,359 INFO [RS:1;jenkins-hbase9:35663] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35663%2C1689159209791.meta:.meta(num 1689159212195) 2023-07-12 10:56:12,364 DEBUG [RS:1;jenkins-hbase9:35663] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/oldWALs 2023-07-12 10:56:12,365 INFO [RS:1;jenkins-hbase9:35663] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35663%2C1689159209791:(num 1689159212044) 2023-07-12 10:56:12,365 DEBUG [RS:1;jenkins-hbase9:35663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:12,365 INFO [RS:1;jenkins-hbase9:35663] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:12,365 INFO [RS:1;jenkins-hbase9:35663] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 10:56:12,365 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 10:56:12,366 INFO [RS:1;jenkins-hbase9:35663] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35663 2023-07-12 10:56:12,367 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:12,367 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35663,1689159209791 2023-07-12 10:56:12,369 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,35663,1689159209791] 2023-07-12 10:56:12,369 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,35663,1689159209791; numProcessing=3 2023-07-12 10:56:12,370 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,35663,1689159209791 already deleted, retry=false 2023-07-12 10:56:12,370 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,35663,1689159209791 expired; onlineServers=0 2023-07-12 10:56:12,370 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,44397,1689159208192' ***** 2023-07-12 10:56:12,370 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 10:56:12,370 DEBUG [M:0;jenkins-hbase9:44397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6b4ff4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-12 10:56:12,370 INFO [M:0;jenkins-hbase9:44397] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,44397,1689159208192 2023-07-12 10:56:12,370 INFO [M:0;jenkins-hbase9:44397] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,44397,1689159208192; all regions closed. 2023-07-12 10:56:12,370 DEBUG [M:0;jenkins-hbase9:44397] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:12,371 DEBUG [M:0;jenkins-hbase9:44397] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 10:56:12,371 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 10:56:12,371 DEBUG [M:0;jenkins-hbase9:44397] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 10:56:12,371 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689159211486] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689159211486,5,FailOnTimeoutGroup] 2023-07-12 10:56:12,371 INFO [M:0;jenkins-hbase9:44397] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 10:56:12,371 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689159211485] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689159211485,5,FailOnTimeoutGroup] 2023-07-12 10:56:12,371 INFO [M:0;jenkins-hbase9:44397] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 10:56:12,371 INFO [M:0;jenkins-hbase9:44397] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-12 10:56:12,371 DEBUG [M:0;jenkins-hbase9:44397] master.HMaster(1512): Stopping service threads 2023-07-12 10:56:12,371 INFO [M:0;jenkins-hbase9:44397] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 10:56:12,372 ERROR [M:0;jenkins-hbase9:44397] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 10:56:12,372 INFO [M:0;jenkins-hbase9:44397] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 10:56:12,372 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 10:56:12,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 10:56:12,374 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:56:12,374 DEBUG [M:0;jenkins-hbase9:44397] zookeeper.ZKUtil(398): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 10:56:12,374 WARN [M:0;jenkins-hbase9:44397] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 10:56:12,374 INFO [M:0;jenkins-hbase9:44397] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 10:56:12,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:56:12,374 INFO [M:0;jenkins-hbase9:44397] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 10:56:12,375 DEBUG [M:0;jenkins-hbase9:44397] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 10:56:12,375 INFO [M:0;jenkins-hbase9:44397] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:56:12,375 DEBUG [M:0;jenkins-hbase9:44397] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:56:12,375 DEBUG [M:0;jenkins-hbase9:44397] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 10:56:12,375 DEBUG [M:0;jenkins-hbase9:44397] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:56:12,376 INFO [M:0;jenkins-hbase9:44397] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.32 KB heapSize=449.54 KB 2023-07-12 10:56:12,465 INFO [M:0;jenkins-hbase9:44397] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.32 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/aaa822509f1c4778b10b9dfb984d81ca 2023-07-12 10:56:12,469 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:12,469 INFO [RS:1;jenkins-hbase9:35663] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,35663,1689159209791; zookeeper connection closed. 2023-07-12 10:56:12,469 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): regionserver:35663-0x101591ccd120002, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:12,469 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@733be8c2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@733be8c2 2023-07-12 10:56:12,469 INFO [Listener at jenkins-hbase9.apache.org/37221] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 10:56:12,474 INFO [M:0;jenkins-hbase9:44397] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aaa822509f1c4778b10b9dfb984d81ca 2023-07-12 10:56:12,475 DEBUG [M:0;jenkins-hbase9:44397] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/aaa822509f1c4778b10b9dfb984d81ca as hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/aaa822509f1c4778b10b9dfb984d81ca 2023-07-12 10:56:12,482 INFO [M:0;jenkins-hbase9:44397] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aaa822509f1c4778b10b9dfb984d81ca 2023-07-12 10:56:12,482 INFO [M:0;jenkins-hbase9:44397] regionserver.HStore(1080): Added hdfs://localhost:37511/user/jenkins/test-data/813ab75e-b967-fcd4-24f4-9a7860da22f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/aaa822509f1c4778b10b9dfb984d81ca, entries=119, sequenceid=899, filesize=28.4 K 2023-07-12 10:56:12,483 INFO [M:0;jenkins-hbase9:44397] regionserver.HRegion(2948): Finished flush of dataSize ~373.32 KB/382275, heapSize ~449.52 KB/460312, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 107ms, sequenceid=899, compaction requested=false 2023-07-12 10:56:12,506 INFO [M:0;jenkins-hbase9:44397] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:56:12,506 DEBUG [M:0;jenkins-hbase9:44397] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 10:56:12,529 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 10:56:12,529 INFO [M:0;jenkins-hbase9:44397] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 10:56:12,529 INFO [M:0;jenkins-hbase9:44397] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44397 2023-07-12 10:56:12,532 DEBUG [M:0;jenkins-hbase9:44397] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,44397,1689159208192 already deleted, retry=false 2023-07-12 10:56:12,634 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:12,634 INFO [M:0;jenkins-hbase9:44397] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,44397,1689159208192; zookeeper connection closed. 2023-07-12 10:56:12,634 DEBUG [Listener at localhost/38331-EventThread] zookeeper.ZKWatcher(600): master:44397-0x101591ccd120000, quorum=127.0.0.1:53956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:12,636 WARN [Listener at jenkins-hbase9.apache.org/37221] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 10:56:12,644 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 10:56:12,648 WARN [BP-529686214-172.31.2.10-1689159204166 heartbeating to localhost/127.0.0.1:37511] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 10:56:12,648 WARN [BP-529686214-172.31.2.10-1689159204166 heartbeating to localhost/127.0.0.1:37511] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-529686214-172.31.2.10-1689159204166 (Datanode Uuid 1dd23df2-64a8-4081-bfab-692570f24121) service to localhost/127.0.0.1:37511 2023-07-12 10:56:12,650 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data5/current/BP-529686214-172.31.2.10-1689159204166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:12,650 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data6/current/BP-529686214-172.31.2.10-1689159204166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:12,653 WARN [Listener at jenkins-hbase9.apache.org/37221] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 10:56:12,660 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 10:56:12,765 WARN [BP-529686214-172.31.2.10-1689159204166 heartbeating to localhost/127.0.0.1:37511] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 10:56:12,765 WARN [BP-529686214-172.31.2.10-1689159204166 heartbeating to localhost/127.0.0.1:37511] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-529686214-172.31.2.10-1689159204166 (Datanode Uuid d50dac8e-6d01-4d3f-9730-7b094d0e8531) service to localhost/127.0.0.1:37511 2023-07-12 10:56:12,766 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data3/current/BP-529686214-172.31.2.10-1689159204166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:12,766 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data4/current/BP-529686214-172.31.2.10-1689159204166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:12,771 WARN [Listener at jenkins-hbase9.apache.org/37221] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 10:56:12,781 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 10:56:12,785 WARN [BP-529686214-172.31.2.10-1689159204166 heartbeating to localhost/127.0.0.1:37511] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 10:56:12,785 WARN [BP-529686214-172.31.2.10-1689159204166 heartbeating to localhost/127.0.0.1:37511] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-529686214-172.31.2.10-1689159204166 (Datanode Uuid f38f507d-4ee0-4d4c-b3d0-f1b38c66a26d) service to localhost/127.0.0.1:37511 2023-07-12 10:56:12,786 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data1/current/BP-529686214-172.31.2.10-1689159204166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:12,786 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c9cc18ca-ce79-6566-cf0f-55e97e91df6c/cluster_ff8cd225-9bb0-c7cf-5880-df0aed0b2daa/dfs/data/data2/current/BP-529686214-172.31.2.10-1689159204166] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:12,823 INFO [Listener at jenkins-hbase9.apache.org/37221] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 10:56:12,952 INFO [Listener at jenkins-hbase9.apache.org/37221] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 10:56:13,082 INFO [Listener at jenkins-hbase9.apache.org/37221] hbase.HBaseTestingUtility(1293): Minicluster is down