2023-09-23 22:00:28,991 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-23 22:00:29,165 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05 2023-09-23 22:00:29,166 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-23 22:00:29,166 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-23 22:00:29,207 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-23 22:00:29,456 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-23 22:00:29,456 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43, deleteOnExit=true 2023-09-23 22:00:29,457 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-23 22:00:29,458 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/test.cache.data in system properties and HBase conf 2023-09-23 22:00:29,458 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop.tmp.dir in system properties and HBase conf 2023-09-23 22:00:29,459 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop.log.dir in system properties and HBase conf 2023-09-23 22:00:29,459 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-23 22:00:29,459 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-23 22:00:29,460 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-23 22:00:29,742 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-23 22:00:29,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-23 22:00:29,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-23 22:00:29,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-23 22:00:29,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 22:00:29,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-23 22:00:29,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-23 22:00:29,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 22:00:29,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 22:00:29,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-23 22:00:29,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/nfs.dump.dir in system properties and HBase conf 2023-09-23 22:00:29,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir in system properties and HBase conf 2023-09-23 22:00:29,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 22:00:29,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-23 22:00:29,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-23 22:00:30,230 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-23 22:00:30,234 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-23 22:00:30,487 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-23 22:00:30,663 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-23 22:00:30,678 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 22:00:30,725 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 22:00:30,779 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir/Jetty_localhost_33149_hdfs____s6serk/webapp 2023-09-23 22:00:30,939 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33149 2023-09-23 22:00:30,978 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-23 22:00:30,978 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-23 22:00:31,369 WARN [Listener at localhost/45753] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 22:00:31,433 WARN [Listener at localhost/45753] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 22:00:31,452 WARN [Listener at localhost/45753] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 22:00:31,458 INFO [Listener at localhost/45753] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 22:00:31,463 INFO [Listener at localhost/45753] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir/Jetty_localhost_38537_datanode____.b6d4jp/webapp 2023-09-23 22:00:31,545 INFO [Listener at localhost/45753] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38537 2023-09-23 22:00:31,995 WARN [Listener at localhost/38321] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 22:00:32,011 WARN [Listener at localhost/38321] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 22:00:32,016 WARN [Listener at localhost/38321] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 22:00:32,018 INFO [Listener at localhost/38321] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 22:00:32,030 INFO [Listener at localhost/38321] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir/Jetty_localhost_32885_datanode____b5c1nh/webapp 2023-09-23 22:00:32,127 INFO [Listener at localhost/38321] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32885 2023-09-23 22:00:32,139 WARN [Listener at localhost/40507] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 22:00:32,168 WARN [Listener at localhost/40507] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 22:00:32,174 WARN [Listener at localhost/40507] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 22:00:32,176 INFO [Listener at localhost/40507] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 22:00:32,185 INFO [Listener at localhost/40507] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir/Jetty_localhost_40443_datanode____.65w9nm/webapp 2023-09-23 22:00:32,277 INFO [Listener at localhost/40507] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40443 2023-09-23 22:00:32,289 WARN [Listener at localhost/33939] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 22:00:32,481 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xca2169205ab844cb: Processing first storage report for DS-5d17b154-31c1-4b38-830a-467bf64ec8af from datanode e41143fc-b293-4e05-9443-dd360d9e7a4c 2023-09-23 22:00:32,483 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xca2169205ab844cb: from storage DS-5d17b154-31c1-4b38-830a-467bf64ec8af node DatanodeRegistration(127.0.0.1:35671, datanodeUuid=e41143fc-b293-4e05-9443-dd360d9e7a4c, infoPort=45377, infoSecurePort=0, ipcPort=38321, storageInfo=lv=-57;cid=testClusterID;nsid=1670704265;c=1695506430310), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-23 22:00:32,483 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaba3cb06f958b363: Processing first storage report for DS-015a69cc-0565-4ae6-aefb-450f46f4e159 from datanode dba406f0-ea64-4692-9dc8-34a989ed6e72 2023-09-23 22:00:32,483 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaba3cb06f958b363: from storage DS-015a69cc-0565-4ae6-aefb-450f46f4e159 node DatanodeRegistration(127.0.0.1:41127, datanodeUuid=dba406f0-ea64-4692-9dc8-34a989ed6e72, infoPort=36181, infoSecurePort=0, ipcPort=40507, storageInfo=lv=-57;cid=testClusterID;nsid=1670704265;c=1695506430310), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 22:00:32,483 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdc47a94af27cab55: Processing first storage report for DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6 from datanode 6bd27096-b0aa-4baa-8c79-92b097c16617 2023-09-23 22:00:32,483 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdc47a94af27cab55: from storage DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6 node DatanodeRegistration(127.0.0.1:42869, datanodeUuid=6bd27096-b0aa-4baa-8c79-92b097c16617, infoPort=36123, infoSecurePort=0, ipcPort=33939, storageInfo=lv=-57;cid=testClusterID;nsid=1670704265;c=1695506430310), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 22:00:32,484 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xca2169205ab844cb: Processing first storage report for DS-26b8d1e2-6229-417c-b882-ddbea8e948ba from datanode e41143fc-b293-4e05-9443-dd360d9e7a4c 2023-09-23 22:00:32,484 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xca2169205ab844cb: from storage DS-26b8d1e2-6229-417c-b882-ddbea8e948ba node DatanodeRegistration(127.0.0.1:35671, datanodeUuid=e41143fc-b293-4e05-9443-dd360d9e7a4c, infoPort=45377, infoSecurePort=0, ipcPort=38321, storageInfo=lv=-57;cid=testClusterID;nsid=1670704265;c=1695506430310), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 22:00:32,484 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaba3cb06f958b363: Processing first storage report for DS-3355bc8d-7283-4e66-847c-3a1366b00ca2 from datanode dba406f0-ea64-4692-9dc8-34a989ed6e72 2023-09-23 22:00:32,484 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaba3cb06f958b363: from storage DS-3355bc8d-7283-4e66-847c-3a1366b00ca2 node DatanodeRegistration(127.0.0.1:41127, datanodeUuid=dba406f0-ea64-4692-9dc8-34a989ed6e72, infoPort=36181, infoSecurePort=0, ipcPort=40507, storageInfo=lv=-57;cid=testClusterID;nsid=1670704265;c=1695506430310), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 22:00:32,484 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdc47a94af27cab55: Processing first storage report for DS-a0c67bba-6883-42d7-aae1-3f638b9825a8 from datanode 6bd27096-b0aa-4baa-8c79-92b097c16617 2023-09-23 22:00:32,484 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdc47a94af27cab55: from storage DS-a0c67bba-6883-42d7-aae1-3f638b9825a8 node DatanodeRegistration(127.0.0.1:42869, datanodeUuid=6bd27096-b0aa-4baa-8c79-92b097c16617, infoPort=36123, infoSecurePort=0, ipcPort=33939, storageInfo=lv=-57;cid=testClusterID;nsid=1670704265;c=1695506430310), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 22:00:32,690 DEBUG [Listener at localhost/33939] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05 2023-09-23 22:00:32,795 INFO [Listener at localhost/33939] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/zookeeper_0, clientPort=58910, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-23 22:00:32,817 INFO [Listener at localhost/33939] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58910 2023-09-23 22:00:32,829 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:32,832 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:33,512 INFO [Listener at localhost/33939] util.FSUtils(471): Created version file at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 with version=8 2023-09-23 22:00:33,512 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/hbase-staging 2023-09-23 22:00:33,913 INFO [Listener at localhost/33939] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-23 22:00:34,312 INFO [Listener at localhost/33939] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-09-23 22:00:34,339 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,339 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,339 INFO [Listener at localhost/33939] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 22:00:34,339 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,340 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 22:00:34,459 INFO [Listener at localhost/33939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 22:00:34,520 DEBUG [Listener at localhost/33939] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-23 22:00:34,602 INFO [Listener at localhost/33939] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36385 2023-09-23 22:00:34,613 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:34,615 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:34,636 INFO [Listener at localhost/33939] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36385 connecting to ZooKeeper ensemble=127.0.0.1:58910 2023-09-23 22:00:34,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:363850x0, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 22:00:34,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36385-0x100c651d42a0000 connected 2023-09-23 22:00:34,712 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 22:00:34,713 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 22:00:34,724 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 22:00:34,732 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36385 2023-09-23 22:00:34,732 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36385 2023-09-23 22:00:34,733 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36385 2023-09-23 22:00:34,733 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36385 2023-09-23 22:00:34,733 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36385 2023-09-23 22:00:34,739 INFO [Listener at localhost/33939] master.HMaster(444): hbase.rootdir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523, hbase.cluster.distributed=false 2023-09-23 22:00:34,796 INFO [Listener at localhost/33939] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-23 22:00:34,797 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,797 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,797 INFO [Listener at localhost/33939] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 22:00:34,797 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,797 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 22:00:34,801 INFO [Listener at localhost/33939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 22:00:34,804 INFO [Listener at localhost/33939] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44169 2023-09-23 22:00:34,807 INFO [Listener at localhost/33939] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 22:00:34,813 INFO [Listener at localhost/33939] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 22:00:34,814 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:34,816 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:34,819 INFO [Listener at localhost/33939] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44169 connecting to ZooKeeper ensemble=127.0.0.1:58910 2023-09-23 22:00:34,822 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:441690x0, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 22:00:34,823 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): regionserver:441690x0, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 22:00:34,827 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): regionserver:441690x0, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 22:00:34,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44169-0x100c651d42a0001 connected 2023-09-23 22:00:34,828 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 22:00:34,829 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44169 2023-09-23 22:00:34,829 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44169 2023-09-23 22:00:34,829 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44169 2023-09-23 22:00:34,830 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44169 2023-09-23 22:00:34,830 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44169 2023-09-23 22:00:34,841 INFO [Listener at localhost/33939] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-23 22:00:34,841 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,842 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,842 INFO [Listener at localhost/33939] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 22:00:34,842 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,842 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 22:00:34,843 INFO [Listener at localhost/33939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 22:00:34,844 INFO [Listener at localhost/33939] ipc.NettyRpcServer(120): Bind to /148.251.75.209:45419 2023-09-23 22:00:34,845 INFO [Listener at localhost/33939] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 22:00:34,847 INFO [Listener at localhost/33939] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 22:00:34,848 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:34,851 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:34,855 INFO [Listener at localhost/33939] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45419 connecting to ZooKeeper ensemble=127.0.0.1:58910 2023-09-23 22:00:34,858 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:454190x0, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 22:00:34,860 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): regionserver:454190x0, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 22:00:34,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45419-0x100c651d42a0002 connected 2023-09-23 22:00:34,861 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 22:00:34,862 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 22:00:34,865 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45419 2023-09-23 22:00:34,865 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45419 2023-09-23 22:00:34,865 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45419 2023-09-23 22:00:34,866 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45419 2023-09-23 22:00:34,870 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45419 2023-09-23 22:00:34,881 INFO [Listener at localhost/33939] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-23 22:00:34,881 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,881 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,881 INFO [Listener at localhost/33939] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 22:00:34,882 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 22:00:34,882 INFO [Listener at localhost/33939] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 22:00:34,882 INFO [Listener at localhost/33939] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 22:00:34,883 INFO [Listener at localhost/33939] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38977 2023-09-23 22:00:34,884 INFO [Listener at localhost/33939] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 22:00:34,885 INFO [Listener at localhost/33939] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 22:00:34,886 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:34,887 INFO [Listener at localhost/33939] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:34,888 INFO [Listener at localhost/33939] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38977 connecting to ZooKeeper ensemble=127.0.0.1:58910 2023-09-23 22:00:34,892 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:389770x0, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 22:00:34,893 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): regionserver:389770x0, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 22:00:34,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38977-0x100c651d42a0003 connected 2023-09-23 22:00:34,894 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 22:00:34,895 DEBUG [Listener at localhost/33939] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 22:00:34,895 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38977 2023-09-23 22:00:34,895 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38977 2023-09-23 22:00:34,896 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38977 2023-09-23 22:00:34,898 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38977 2023-09-23 22:00:34,899 DEBUG [Listener at localhost/33939] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38977 2023-09-23 22:00:34,900 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:00:34,909 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-23 22:00:34,910 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:00:34,927 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 22:00:34,927 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 22:00:34,927 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 22:00:34,927 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 22:00:34,927 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:00:34,928 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-23 22:00:34,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,36385,1695506433721 from backup master directory 2023-09-23 22:00:34,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-23 22:00:34,945 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:00:34,946 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-23 22:00:34,947 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 22:00:34,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:00:34,950 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-23 22:00:34,952 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-23 22:00:35,043 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/hbase.id with ID: a428bcae-02da-43d8-a844-e38bb7cc7bc4 2023-09-23 22:00:35,093 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 22:00:35,109 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:00:35,158 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x67d0e7ff to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:35,188 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40583a07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:35,210 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-23 22:00:35,211 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-23 22:00:35,226 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-23 22:00:35,226 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-23 22:00:35,228 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-23 22:00:35,232 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-23 22:00:35,233 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 22:00:35,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/data/master/store-tmp 2023-09-23 22:00:35,301 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:35,301 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-23 22:00:35,301 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 22:00:35,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 22:00:35,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-23 22:00:35,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 22:00:35,302 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 22:00:35,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 22:00:35,304 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/WALs/jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:00:35,327 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36385%2C1695506433721, suffix=, logDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/WALs/jenkins-hbase20.apache.org,36385,1695506433721, archiveDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/oldWALs, maxLogs=10 2023-09-23 22:00:35,382 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK] 2023-09-23 22:00:35,382 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK] 2023-09-23 22:00:35,382 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK] 2023-09-23 22:00:35,389 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-23 22:00:35,454 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/WALs/jenkins-hbase20.apache.org,36385,1695506433721/jenkins-hbase20.apache.org%2C36385%2C1695506433721.1695506435336 2023-09-23 22:00:35,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK], DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK], DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK]] 2023-09-23 22:00:35,455 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-23 22:00:35,455 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:35,458 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 22:00:35,459 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 22:00:35,516 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-23 22:00:35,524 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-23 22:00:35,556 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-23 22:00:35,567 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:35,572 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-23 22:00:35,574 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-23 22:00:35,588 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 22:00:35,592 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:00:35,593 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67012603, jitterRate=-0.0014344006776809692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:00:35,593 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 22:00:35,594 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-23 22:00:35,613 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-23 22:00:35,613 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-23 22:00:35,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-23 22:00:35,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-23 22:00:35,646 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 28 msec 2023-09-23 22:00:35,646 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-23 22:00:35,672 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-23 22:00:35,677 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-23 22:00:35,697 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-23 22:00:35,701 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-23 22:00:35,703 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-23 22:00:35,708 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-23 22:00:35,711 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-23 22:00:35,713 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:00:35,715 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-23 22:00:35,715 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-23 22:00:35,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-23 22:00:35,731 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 22:00:35,731 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 22:00:35,731 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 22:00:35,731 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 22:00:35,731 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:00:35,732 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,36385,1695506433721, sessionid=0x100c651d42a0000, setting cluster-up flag (Was=false) 2023-09-23 22:00:35,746 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:00:35,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-23 22:00:35,751 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:00:35,757 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:00:35,760 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-23 22:00:35,761 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:00:35,763 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp 2023-09-23 22:00:35,803 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(951): ClusterId : a428bcae-02da-43d8-a844-e38bb7cc7bc4 2023-09-23 22:00:35,803 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(951): ClusterId : a428bcae-02da-43d8-a844-e38bb7cc7bc4 2023-09-23 22:00:35,803 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(951): ClusterId : a428bcae-02da-43d8-a844-e38bb7cc7bc4 2023-09-23 22:00:35,809 DEBUG [RS:1;jenkins-hbase20:45419] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 22:00:35,809 DEBUG [RS:0;jenkins-hbase20:44169] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 22:00:35,809 DEBUG [RS:2;jenkins-hbase20:38977] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 22:00:35,814 DEBUG [RS:2;jenkins-hbase20:38977] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 22:00:35,814 DEBUG [RS:0;jenkins-hbase20:44169] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 22:00:35,814 DEBUG [RS:1;jenkins-hbase20:45419] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 22:00:35,814 DEBUG [RS:0;jenkins-hbase20:44169] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 22:00:35,814 DEBUG [RS:2;jenkins-hbase20:38977] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 22:00:35,815 DEBUG [RS:1;jenkins-hbase20:45419] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 22:00:35,818 DEBUG [RS:1;jenkins-hbase20:45419] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 22:00:35,818 DEBUG [RS:0;jenkins-hbase20:44169] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 22:00:35,818 DEBUG [RS:2;jenkins-hbase20:38977] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 22:00:35,822 DEBUG [RS:0;jenkins-hbase20:44169] zookeeper.ReadOnlyZKClient(139): Connect 0x74157c6c to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:35,823 DEBUG [RS:2;jenkins-hbase20:38977] zookeeper.ReadOnlyZKClient(139): Connect 0x77c8214c to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:35,822 DEBUG [RS:1;jenkins-hbase20:45419] zookeeper.ReadOnlyZKClient(139): Connect 0x0d193553 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:35,833 DEBUG [RS:2;jenkins-hbase20:38977] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@790fc1c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:35,836 DEBUG [RS:2;jenkins-hbase20:38977] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d304a3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-23 22:00:35,841 DEBUG [RS:1;jenkins-hbase20:45419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3deca80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:35,841 DEBUG [RS:0;jenkins-hbase20:44169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ad29c9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:35,842 DEBUG [RS:1;jenkins-hbase20:45419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e15e23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-23 22:00:35,842 DEBUG [RS:0;jenkins-hbase20:44169] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7eed171c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-23 22:00:35,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-23 22:00:35,858 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:35,859 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-23 22:00:35,867 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:44169 2023-09-23 22:00:35,867 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:45419 2023-09-23 22:00:35,868 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:38977 2023-09-23 22:00:35,872 INFO [RS:2;jenkins-hbase20:38977] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 22:00:35,872 INFO [RS:0;jenkins-hbase20:44169] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 22:00:35,872 INFO [RS:1;jenkins-hbase20:45419] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 22:00:35,873 INFO [RS:1;jenkins-hbase20:45419] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 22:00:35,873 INFO [RS:0;jenkins-hbase20:44169] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 22:00:35,873 INFO [RS:2;jenkins-hbase20:38977] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 22:00:35,873 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 22:00:35,873 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 22:00:35,873 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 22:00:35,874 INFO [RS:1;jenkins-hbase20:45419] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:35,874 INFO [RS:2;jenkins-hbase20:38977] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:35,874 INFO [RS:0;jenkins-hbase20:44169] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:35,874 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 22:00:35,874 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 22:00:35,874 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 22:00:35,877 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36385,1695506433721 with isa=jenkins-hbase20.apache.org/148.251.75.209:45419, startcode=1695506434840 2023-09-23 22:00:35,877 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36385,1695506433721 with isa=jenkins-hbase20.apache.org/148.251.75.209:38977, startcode=1695506434881 2023-09-23 22:00:35,877 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36385,1695506433721 with isa=jenkins-hbase20.apache.org/148.251.75.209:44169, startcode=1695506434796 2023-09-23 22:00:35,893 DEBUG [RS:2;jenkins-hbase20:38977] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 22:00:35,893 DEBUG [RS:1;jenkins-hbase20:45419] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 22:00:35,893 DEBUG [RS:0;jenkins-hbase20:44169] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 22:00:35,964 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34639, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 22:00:35,964 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42349, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 22:00:35,964 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39527, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 22:00:35,968 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-23 22:00:35,973 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36385] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 22:00:35,977 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-23 22:00:35,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-23 22:00:35,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-23 22:00:35,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-23 22:00:35,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-09-23 22:00:35,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:35,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-23 22:00:35,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:35,980 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36385] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 22:00:35,980 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36385] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 22:00:35,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695506465982 2023-09-23 22:00:35,984 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-23 22:00:35,992 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-23 22:00:35,992 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-23 22:00:35,996 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-23 22:00:35,998 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 22:00:36,002 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-23 22:00:36,003 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-23 22:00:36,003 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-23 22:00:36,003 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-23 22:00:36,005 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 22:00:36,006 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,007 WARN [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 22:00:36,005 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 22:00:36,005 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 22:00:36,007 WARN [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 22:00:36,007 WARN [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 22:00:36,008 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-23 22:00:36,009 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-23 22:00:36,010 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-23 22:00:36,016 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-23 22:00:36,016 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-23 22:00:36,018 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1695506436018,5,FailOnTimeoutGroup] 2023-09-23 22:00:36,018 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1695506436018,5,FailOnTimeoutGroup] 2023-09-23 22:00:36,018 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,018 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-23 22:00:36,021 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,021 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,041 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-23 22:00:36,042 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-23 22:00:36,042 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:00:36,062 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:36,065 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-23 22:00:36,067 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/info 2023-09-23 22:00:36,068 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-23 22:00:36,069 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:36,069 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-23 22:00:36,071 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/rep_barrier 2023-09-23 22:00:36,072 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-23 22:00:36,072 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:36,073 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-23 22:00:36,075 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/table 2023-09-23 22:00:36,075 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-23 22:00:36,076 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:36,078 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740 2023-09-23 22:00:36,079 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740 2023-09-23 22:00:36,083 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-23 22:00:36,085 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-23 22:00:36,089 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:00:36,090 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69450291, jitterRate=0.034889981150627136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-23 22:00:36,090 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-23 22:00:36,090 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-23 22:00:36,091 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-23 22:00:36,091 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-23 22:00:36,091 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-23 22:00:36,091 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-23 22:00:36,093 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-23 22:00:36,093 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-23 22:00:36,099 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-23 22:00:36,099 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-23 22:00:36,108 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36385,1695506433721 with isa=jenkins-hbase20.apache.org/148.251.75.209:44169, startcode=1695506434796 2023-09-23 22:00:36,108 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36385,1695506433721 with isa=jenkins-hbase20.apache.org/148.251.75.209:45419, startcode=1695506434840 2023-09-23 22:00:36,108 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36385,1695506433721 with isa=jenkins-hbase20.apache.org/148.251.75.209:38977, startcode=1695506434881 2023-09-23 22:00:36,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-23 22:00:36,115 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36385] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:36,120 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36385] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:36,121 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:00:36,121 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36385] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:36,121 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45753 2023-09-23 22:00:36,121 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 22:00:36,122 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:00:36,122 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45753 2023-09-23 22:00:36,122 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 22:00:36,123 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:00:36,123 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45753 2023-09-23 22:00:36,123 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 22:00:36,128 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-23 22:00:36,129 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 22:00:36,131 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-23 22:00:36,131 DEBUG [RS:1;jenkins-hbase20:45419] zookeeper.ZKUtil(162): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:36,132 WARN [RS:1;jenkins-hbase20:45419] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 22:00:36,132 DEBUG [RS:2;jenkins-hbase20:38977] zookeeper.ZKUtil(162): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:36,132 INFO [RS:1;jenkins-hbase20:45419] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 22:00:36,132 DEBUG [RS:0;jenkins-hbase20:44169] zookeeper.ZKUtil(162): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:36,132 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,45419,1695506434840] 2023-09-23 22:00:36,132 WARN [RS:2;jenkins-hbase20:38977] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 22:00:36,133 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38977,1695506434881] 2023-09-23 22:00:36,133 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44169,1695506434796] 2023-09-23 22:00:36,133 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:36,133 WARN [RS:0;jenkins-hbase20:44169] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 22:00:36,133 INFO [RS:2;jenkins-hbase20:38977] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 22:00:36,133 INFO [RS:0;jenkins-hbase20:44169] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 22:00:36,133 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:36,133 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:36,146 DEBUG [RS:1;jenkins-hbase20:45419] zookeeper.ZKUtil(162): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:36,146 DEBUG [RS:2;jenkins-hbase20:38977] zookeeper.ZKUtil(162): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:36,146 DEBUG [RS:0;jenkins-hbase20:44169] zookeeper.ZKUtil(162): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:36,146 DEBUG [RS:1;jenkins-hbase20:45419] zookeeper.ZKUtil(162): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:36,146 DEBUG [RS:2;jenkins-hbase20:38977] zookeeper.ZKUtil(162): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:36,146 DEBUG [RS:0;jenkins-hbase20:44169] zookeeper.ZKUtil(162): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:36,146 DEBUG [RS:1;jenkins-hbase20:45419] zookeeper.ZKUtil(162): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:36,146 DEBUG [RS:2;jenkins-hbase20:38977] zookeeper.ZKUtil(162): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:36,147 DEBUG [RS:0;jenkins-hbase20:44169] zookeeper.ZKUtil(162): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:36,157 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 22:00:36,157 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 22:00:36,157 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 22:00:36,167 INFO [RS:1;jenkins-hbase20:45419] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 22:00:36,167 INFO [RS:0;jenkins-hbase20:44169] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 22:00:36,167 INFO [RS:2;jenkins-hbase20:38977] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 22:00:36,197 INFO [RS:1;jenkins-hbase20:45419] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 22:00:36,198 INFO [RS:2;jenkins-hbase20:38977] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 22:00:36,197 INFO [RS:0;jenkins-hbase20:44169] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 22:00:36,202 INFO [RS:1;jenkins-hbase20:45419] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 22:00:36,202 INFO [RS:0;jenkins-hbase20:44169] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 22:00:36,202 INFO [RS:2;jenkins-hbase20:38977] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 22:00:36,203 INFO [RS:0;jenkins-hbase20:44169] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,203 INFO [RS:1;jenkins-hbase20:45419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,203 INFO [RS:2;jenkins-hbase20:38977] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,204 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 22:00:36,204 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 22:00:36,209 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 22:00:36,218 INFO [RS:1;jenkins-hbase20:45419] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,218 INFO [RS:2;jenkins-hbase20:38977] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,218 INFO [RS:0;jenkins-hbase20:44169] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,218 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,219 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-23 22:00:36,220 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-23 22:00:36,219 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-23 22:00:36,220 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:2;jenkins-hbase20:38977] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,220 DEBUG [RS:0;jenkins-hbase20:44169] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,221 DEBUG [RS:1;jenkins-hbase20:45419] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-23 22:00:36,222 INFO [RS:2;jenkins-hbase20:38977] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,222 INFO [RS:2;jenkins-hbase20:38977] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,222 INFO [RS:2;jenkins-hbase20:38977] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,222 INFO [RS:0;jenkins-hbase20:44169] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,222 INFO [RS:0;jenkins-hbase20:44169] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,223 INFO [RS:0;jenkins-hbase20:44169] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,225 INFO [RS:1;jenkins-hbase20:45419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,225 INFO [RS:1;jenkins-hbase20:45419] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,226 INFO [RS:1;jenkins-hbase20:45419] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,239 INFO [RS:2;jenkins-hbase20:38977] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 22:00:36,239 INFO [RS:0;jenkins-hbase20:44169] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 22:00:36,239 INFO [RS:1;jenkins-hbase20:45419] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 22:00:36,242 INFO [RS:2;jenkins-hbase20:38977] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38977,1695506434881-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,242 INFO [RS:0;jenkins-hbase20:44169] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44169,1695506434796-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,242 INFO [RS:1;jenkins-hbase20:45419] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45419,1695506434840-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,266 INFO [RS:1;jenkins-hbase20:45419] regionserver.Replication(203): jenkins-hbase20.apache.org,45419,1695506434840 started 2023-09-23 22:00:36,266 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,45419,1695506434840, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:45419, sessionid=0x100c651d42a0002 2023-09-23 22:00:36,267 INFO [RS:0;jenkins-hbase20:44169] regionserver.Replication(203): jenkins-hbase20.apache.org,44169,1695506434796 started 2023-09-23 22:00:36,267 DEBUG [RS:1;jenkins-hbase20:45419] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 22:00:36,267 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,44169,1695506434796, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44169, sessionid=0x100c651d42a0001 2023-09-23 22:00:36,267 DEBUG [RS:1;jenkins-hbase20:45419] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:36,267 INFO [RS:2;jenkins-hbase20:38977] regionserver.Replication(203): jenkins-hbase20.apache.org,38977,1695506434881 started 2023-09-23 22:00:36,267 DEBUG [RS:1;jenkins-hbase20:45419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,45419,1695506434840' 2023-09-23 22:00:36,267 DEBUG [RS:0;jenkins-hbase20:44169] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 22:00:36,267 DEBUG [RS:1;jenkins-hbase20:45419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 22:00:36,267 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,38977,1695506434881, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38977, sessionid=0x100c651d42a0003 2023-09-23 22:00:36,267 DEBUG [RS:0;jenkins-hbase20:44169] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:36,268 DEBUG [RS:2;jenkins-hbase20:38977] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 22:00:36,268 DEBUG [RS:0;jenkins-hbase20:44169] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44169,1695506434796' 2023-09-23 22:00:36,269 DEBUG [RS:0;jenkins-hbase20:44169] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 22:00:36,269 DEBUG [RS:1;jenkins-hbase20:45419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 22:00:36,269 DEBUG [RS:0;jenkins-hbase20:44169] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 22:00:36,269 DEBUG [RS:1;jenkins-hbase20:45419] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 22:00:36,269 DEBUG [RS:1;jenkins-hbase20:45419] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 22:00:36,269 DEBUG [RS:1;jenkins-hbase20:45419] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:36,270 DEBUG [RS:1;jenkins-hbase20:45419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,45419,1695506434840' 2023-09-23 22:00:36,270 DEBUG [RS:1;jenkins-hbase20:45419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:36,270 DEBUG [RS:1;jenkins-hbase20:45419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:36,268 DEBUG [RS:2;jenkins-hbase20:38977] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:36,270 DEBUG [RS:0;jenkins-hbase20:44169] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 22:00:36,270 DEBUG [RS:2;jenkins-hbase20:38977] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38977,1695506434881' 2023-09-23 22:00:36,270 DEBUG [RS:2;jenkins-hbase20:38977] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 22:00:36,270 DEBUG [RS:0;jenkins-hbase20:44169] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 22:00:36,270 DEBUG [RS:1;jenkins-hbase20:45419] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 22:00:36,271 DEBUG [RS:0;jenkins-hbase20:44169] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:36,271 INFO [RS:1;jenkins-hbase20:45419] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 22:00:36,271 DEBUG [RS:0;jenkins-hbase20:44169] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44169,1695506434796' 2023-09-23 22:00:36,271 DEBUG [RS:0;jenkins-hbase20:44169] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:36,271 DEBUG [RS:2;jenkins-hbase20:38977] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 22:00:36,271 INFO [RS:1;jenkins-hbase20:45419] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 22:00:36,272 DEBUG [RS:2;jenkins-hbase20:38977] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 22:00:36,272 DEBUG [RS:0;jenkins-hbase20:44169] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:36,272 DEBUG [RS:2;jenkins-hbase20:38977] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 22:00:36,272 DEBUG [RS:2;jenkins-hbase20:38977] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:36,272 DEBUG [RS:2;jenkins-hbase20:38977] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38977,1695506434881' 2023-09-23 22:00:36,272 DEBUG [RS:2;jenkins-hbase20:38977] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:36,273 DEBUG [RS:0;jenkins-hbase20:44169] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 22:00:36,273 INFO [RS:0;jenkins-hbase20:44169] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 22:00:36,273 INFO [RS:0;jenkins-hbase20:44169] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 22:00:36,275 DEBUG [RS:2;jenkins-hbase20:38977] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:36,275 DEBUG [RS:2;jenkins-hbase20:38977] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 22:00:36,275 INFO [RS:2;jenkins-hbase20:38977] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 22:00:36,276 INFO [RS:2;jenkins-hbase20:38977] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 22:00:36,284 DEBUG [jenkins-hbase20:36385] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-23 22:00:36,288 DEBUG [jenkins-hbase20:36385] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:00:36,293 DEBUG [jenkins-hbase20:36385] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:00:36,293 DEBUG [jenkins-hbase20:36385] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:00:36,293 DEBUG [jenkins-hbase20:36385] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:00:36,293 DEBUG [jenkins-hbase20:36385] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:00:36,296 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38977,1695506434881, state=OPENING 2023-09-23 22:00:36,302 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-23 22:00:36,303 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:00:36,304 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-23 22:00:36,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:00:36,384 INFO [RS:0;jenkins-hbase20:44169] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44169%2C1695506434796, suffix=, logDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,44169,1695506434796, archiveDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/oldWALs, maxLogs=32 2023-09-23 22:00:36,384 INFO [RS:2;jenkins-hbase20:38977] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38977%2C1695506434881, suffix=, logDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,38977,1695506434881, archiveDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/oldWALs, maxLogs=32 2023-09-23 22:00:36,384 INFO [RS:1;jenkins-hbase20:45419] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C45419%2C1695506434840, suffix=, logDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,45419,1695506434840, archiveDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/oldWALs, maxLogs=32 2023-09-23 22:00:36,404 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK] 2023-09-23 22:00:36,404 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK] 2023-09-23 22:00:36,405 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK] 2023-09-23 22:00:36,417 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK] 2023-09-23 22:00:36,417 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK] 2023-09-23 22:00:36,427 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK] 2023-09-23 22:00:36,427 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK] 2023-09-23 22:00:36,428 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK] 2023-09-23 22:00:36,429 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK] 2023-09-23 22:00:36,429 INFO [RS:1;jenkins-hbase20:45419] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,45419,1695506434840/jenkins-hbase20.apache.org%2C45419%2C1695506434840.1695506436387 2023-09-23 22:00:36,430 DEBUG [RS:1;jenkins-hbase20:45419] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK], DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK], DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK]] 2023-09-23 22:00:36,443 INFO [RS:0;jenkins-hbase20:44169] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,44169,1695506434796/jenkins-hbase20.apache.org%2C44169%2C1695506434796.1695506436387 2023-09-23 22:00:36,443 INFO [RS:2;jenkins-hbase20:38977] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,38977,1695506434881/jenkins-hbase20.apache.org%2C38977%2C1695506434881.1695506436387 2023-09-23 22:00:36,444 DEBUG [RS:0;jenkins-hbase20:44169] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK], DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK], DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK]] 2023-09-23 22:00:36,444 DEBUG [RS:2;jenkins-hbase20:38977] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK], DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK], DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK]] 2023-09-23 22:00:36,497 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:36,500 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 22:00:36,503 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45036, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 22:00:36,518 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-23 22:00:36,519 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 22:00:36,522 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38977%2C1695506434881.meta, suffix=.meta, logDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,38977,1695506434881, archiveDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/oldWALs, maxLogs=32 2023-09-23 22:00:36,541 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK] 2023-09-23 22:00:36,541 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK] 2023-09-23 22:00:36,548 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK] 2023-09-23 22:00:36,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/WALs/jenkins-hbase20.apache.org,38977,1695506434881/jenkins-hbase20.apache.org%2C38977%2C1695506434881.meta.1695506436524.meta 2023-09-23 22:00:36,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42869,DS-0ad0fe32-f4c1-44b6-bf43-7e32b62f99f6,DISK], DatanodeInfoWithStorage[127.0.0.1:35671,DS-5d17b154-31c1-4b38-830a-467bf64ec8af,DISK], DatanodeInfoWithStorage[127.0.0.1:41127,DS-015a69cc-0565-4ae6-aefb-450f46f4e159,DISK]] 2023-09-23 22:00:36,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-23 22:00:36,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-23 22:00:36,568 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:36,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-23 22:00:36,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-23 22:00:36,573 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-23 22:00:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-23 22:00:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-23 22:00:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-23 22:00:36,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-23 22:00:36,589 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/info 2023-09-23 22:00:36,590 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/info 2023-09-23 22:00:36,590 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-23 22:00:36,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:36,592 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-23 22:00:36,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/rep_barrier 2023-09-23 22:00:36,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/rep_barrier 2023-09-23 22:00:36,594 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-23 22:00:36,595 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:36,595 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-23 22:00:36,597 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/table 2023-09-23 22:00:36,597 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/table 2023-09-23 22:00:36,598 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-23 22:00:36,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:36,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740 2023-09-23 22:00:36,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740 2023-09-23 22:00:36,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-23 22:00:36,610 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-23 22:00:36,611 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74956591, jitterRate=0.11694024503231049}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-23 22:00:36,613 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-23 22:00:36,621 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695506436488 2023-09-23 22:00:36,639 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-23 22:00:36,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-23 22:00:36,640 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38977,1695506434881, state=OPEN 2023-09-23 22:00:36,643 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-23 22:00:36,643 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-23 22:00:36,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-23 22:00:36,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38977,1695506434881 in 336 msec 2023-09-23 22:00:36,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-23 22:00:36,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 543 msec 2023-09-23 22:00:36,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 803 msec 2023-09-23 22:00:36,673 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695506436673, completionTime=-1 2023-09-23 22:00:36,673 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-23 22:00:36,673 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-23 22:00:36,736 DEBUG [hconnection-0x33baf094-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:36,739 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:36,758 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-23 22:00:36,758 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695506496758 2023-09-23 22:00:36,758 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695506556758 2023-09-23 22:00:36,759 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 85 msec 2023-09-23 22:00:36,792 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36385,1695506433721-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,792 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36385,1695506433721-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,792 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36385,1695506433721-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,794 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:36385, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,794 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-23 22:00:36,802 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-23 22:00:36,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-23 22:00:36,809 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 22:00:36,817 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-23 22:00:36,820 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 22:00:36,823 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 22:00:36,844 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:00:36,846 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f empty. 2023-09-23 22:00:36,847 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:00:36,847 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-23 22:00:36,892 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-23 22:00:36,895 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 62ae6d0ab3b18432a12965c3191ff10f, NAME => 'hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:00:36,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:36,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 62ae6d0ab3b18432a12965c3191ff10f, disabling compactions & flushes 2023-09-23 22:00:36,916 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:00:36,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:00:36,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. after waiting 0 ms 2023-09-23 22:00:36,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:00:36,916 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:00:36,916 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 62ae6d0ab3b18432a12965c3191ff10f: 2023-09-23 22:00:36,922 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 22:00:36,935 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695506436925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506436925"}]},"ts":"1695506436925"} 2023-09-23 22:00:36,960 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-23 22:00:36,962 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 22:00:36,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506436963"}]},"ts":"1695506436963"} 2023-09-23 22:00:36,971 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-23 22:00:36,975 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:00:36,976 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:00:36,976 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:00:36,976 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:00:36,976 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:00:36,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62ae6d0ab3b18432a12965c3191ff10f, ASSIGN}] 2023-09-23 22:00:36,982 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62ae6d0ab3b18432a12965c3191ff10f, ASSIGN 2023-09-23 22:00:36,986 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=62ae6d0ab3b18432a12965c3191ff10f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45419,1695506434840; forceNewPlan=false, retain=false 2023-09-23 22:00:37,138 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 22:00:37,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62ae6d0ab3b18432a12965c3191ff10f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:37,139 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695506437139"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506437139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506437139"}]},"ts":"1695506437139"} 2023-09-23 22:00:37,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 62ae6d0ab3b18432a12965c3191ff10f, server=jenkins-hbase20.apache.org,45419,1695506434840}] 2023-09-23 22:00:37,300 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:37,300 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 22:00:37,303 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 22:00:37,309 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:00:37,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62ae6d0ab3b18432a12965c3191ff10f, NAME => 'hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f.', STARTKEY => '', ENDKEY => ''} 2023-09-23 22:00:37,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. service=AccessControlService 2023-09-23 22:00:37,310 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:37,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:00:37,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:37,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:00:37,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:00:37,314 INFO [StoreOpener-62ae6d0ab3b18432a12965c3191ff10f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:00:37,316 DEBUG [StoreOpener-62ae6d0ab3b18432a12965c3191ff10f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f/info 2023-09-23 22:00:37,316 DEBUG [StoreOpener-62ae6d0ab3b18432a12965c3191ff10f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f/info 2023-09-23 22:00:37,317 INFO [StoreOpener-62ae6d0ab3b18432a12965c3191ff10f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62ae6d0ab3b18432a12965c3191ff10f columnFamilyName info 2023-09-23 22:00:37,318 INFO [StoreOpener-62ae6d0ab3b18432a12965c3191ff10f-1] regionserver.HStore(310): Store=62ae6d0ab3b18432a12965c3191ff10f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:37,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:00:37,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:00:37,326 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:00:37,330 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:00:37,331 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 62ae6d0ab3b18432a12965c3191ff10f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62402376, jitterRate=-0.07013213634490967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:00:37,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 62ae6d0ab3b18432a12965c3191ff10f: 2023-09-23 22:00:37,333 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f., pid=6, masterSystemTime=1695506437300 2023-09-23 22:00:37,338 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:00:37,338 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:00:37,340 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62ae6d0ab3b18432a12965c3191ff10f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:37,340 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695506437339"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506437339"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506437339"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506437339"}]},"ts":"1695506437339"} 2023-09-23 22:00:37,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-23 22:00:37,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 62ae6d0ab3b18432a12965c3191ff10f, server=jenkins-hbase20.apache.org,45419,1695506434840 in 198 msec 2023-09-23 22:00:37,352 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-23 22:00:37,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=62ae6d0ab3b18432a12965c3191ff10f, ASSIGN in 369 msec 2023-09-23 22:00:37,354 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 22:00:37,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506437354"}]},"ts":"1695506437354"} 2023-09-23 22:00:37,357 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-23 22:00:37,360 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 22:00:37,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 550 msec 2023-09-23 22:00:37,420 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-23 22:00:37,421 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-23 22:00:37,421 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:00:37,443 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:37,447 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:37,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-23 22:00:37,504 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-23 22:00:37,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 57 msec 2023-09-23 22:00:37,524 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-23 22:00:37,536 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-23 22:00:37,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-23 22:00:37,549 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-23 22:00:37,551 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-23 22:00:37,551 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.604sec 2023-09-23 22:00:37,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-23 22:00:37,556 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-23 22:00:37,556 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-23 22:00:37,558 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36385,1695506433721-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-23 22:00:37,558 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36385,1695506433721-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-23 22:00:37,578 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 22:00:37,580 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-23 22:00:37,582 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 22:00:37,584 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 22:00:37,587 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:00:37,588 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb empty. 2023-09-23 22:00:37,588 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-23 22:00:37,590 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:00:37,590 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-23 22:00:37,597 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 22:00:37,614 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-23 22:00:37,615 DEBUG [Listener at localhost/33939] zookeeper.ReadOnlyZKClient(139): Connect 0x1e62b284 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:37,618 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6d9d3cf10b4fdbd9698928da6b7ddacb, NAME => 'hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:00:37,620 DEBUG [Listener at localhost/33939] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76b930eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:37,645 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:37,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 6d9d3cf10b4fdbd9698928da6b7ddacb, disabling compactions & flushes 2023-09-23 22:00:37,646 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:00:37,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:00:37,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. after waiting 0 ms 2023-09-23 22:00:37,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:00:37,646 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:00:37,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 6d9d3cf10b4fdbd9698928da6b7ddacb: 2023-09-23 22:00:37,647 DEBUG [hconnection-0xbee159b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:37,651 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 22:00:37,653 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695506437653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506437653"}]},"ts":"1695506437653"} 2023-09-23 22:00:37,658 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-23 22:00:37,660 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:37,661 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 22:00:37,661 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506437661"}]},"ts":"1695506437661"} 2023-09-23 22:00:37,663 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:00:37,663 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-23 22:00:37,663 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/test.cache.data in system properties and HBase conf 2023-09-23 22:00:37,663 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop.tmp.dir in system properties and HBase conf 2023-09-23 22:00:37,663 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop.log.dir in system properties and HBase conf 2023-09-23 22:00:37,663 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 22:00:37,664 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-23 22:00:37,665 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/nfs.dump.dir in system properties and HBase conf 2023-09-23 22:00:37,665 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-23 22:00:37,665 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir in system properties and HBase conf 2023-09-23 22:00:37,665 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 22:00:37,665 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-23 22:00:37,665 INFO [Listener at localhost/33939] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-23 22:00:37,668 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:00:37,669 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:00:37,669 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:00:37,669 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:00:37,669 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:00:37,670 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6d9d3cf10b4fdbd9698928da6b7ddacb, ASSIGN}] 2023-09-23 22:00:37,672 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6d9d3cf10b4fdbd9698928da6b7ddacb, ASSIGN 2023-09-23 22:00:37,674 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=6d9d3cf10b4fdbd9698928da6b7ddacb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44169,1695506434796; forceNewPlan=false, retain=false 2023-09-23 22:00:37,701 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 22:00:37,825 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 22:00:37,826 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d9d3cf10b4fdbd9698928da6b7ddacb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:37,826 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695506437826"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506437826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506437826"}]},"ts":"1695506437826"} 2023-09-23 22:00:37,829 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6d9d3cf10b4fdbd9698928da6b7ddacb, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:00:37,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 22:00:37,983 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:37,983 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 22:00:37,987 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 22:00:37,994 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:00:37,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d9d3cf10b4fdbd9698928da6b7ddacb, NAME => 'hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb.', STARTKEY => '', ENDKEY => ''} 2023-09-23 22:00:37,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. service=AccessControlService 2023-09-23 22:00:37,995 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:37,995 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:00:37,995 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:37,995 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:00:37,995 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:00:37,997 INFO [StoreOpener-6d9d3cf10b4fdbd9698928da6b7ddacb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:00:38,000 DEBUG [StoreOpener-6d9d3cf10b4fdbd9698928da6b7ddacb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb/l 2023-09-23 22:00:38,000 DEBUG [StoreOpener-6d9d3cf10b4fdbd9698928da6b7ddacb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb/l 2023-09-23 22:00:38,001 INFO [StoreOpener-6d9d3cf10b4fdbd9698928da6b7ddacb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d9d3cf10b4fdbd9698928da6b7ddacb columnFamilyName l 2023-09-23 22:00:38,002 INFO [StoreOpener-6d9d3cf10b4fdbd9698928da6b7ddacb-1] regionserver.HStore(310): Store=6d9d3cf10b4fdbd9698928da6b7ddacb/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:38,004 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:00:38,006 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:00:38,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:00:38,018 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:00:38,019 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6d9d3cf10b4fdbd9698928da6b7ddacb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73903644, jitterRate=0.10125011205673218}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:00:38,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6d9d3cf10b4fdbd9698928da6b7ddacb: 2023-09-23 22:00:38,022 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb., pid=11, masterSystemTime=1695506437983 2023-09-23 22:00:38,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:00:38,027 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:00:38,028 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d9d3cf10b4fdbd9698928da6b7ddacb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:38,029 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695506438028"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506438028"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506438028"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506438028"}]},"ts":"1695506438028"} 2023-09-23 22:00:38,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-23 22:00:38,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6d9d3cf10b4fdbd9698928da6b7ddacb, server=jenkins-hbase20.apache.org,44169,1695506434796 in 211 msec 2023-09-23 22:00:38,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-23 22:00:38,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=6d9d3cf10b4fdbd9698928da6b7ddacb, ASSIGN in 375 msec 2023-09-23 22:00:38,052 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 22:00:38,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506438052"}]},"ts":"1695506438052"} 2023-09-23 22:00:38,055 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-23 22:00:38,058 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 22:00:38,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 480 msec 2023-09-23 22:00:38,202 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 22:00:38,202 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-23 22:00:38,216 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-23 22:00:38,823 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 22:00:39,205 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 22:00:39,211 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_38805_jobhistory____.anpn63/webapp 2023-09-23 22:00:39,362 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-23 22:00:39,362 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-23 22:00:39,362 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 22:00:39,364 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 22:00:39,437 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:39,722 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:40,087 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-23 22:00:40,128 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:38805 2023-09-23 22:00:40,308 WARN [Listener at jenkins-hbase20.apache.org/37513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 22:00:40,533 WARN [Listener at jenkins-hbase20.apache.org/37513] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 22:00:40,534 INFO [Listener at jenkins-hbase20.apache.org/37513] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 22:00:40,540 INFO [Listener at jenkins-hbase20.apache.org/37513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_39889_cluster____.ouk3mr/webapp 2023-09-23 22:00:40,599 INFO [Listener at jenkins-hbase20.apache.org/37513] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 22:00:40,599 INFO [Listener at jenkins-hbase20.apache.org/37513] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-23 22:00:40,599 INFO [Listener at jenkins-hbase20.apache.org/37513] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 22:00:40,600 INFO [Listener at jenkins-hbase20.apache.org/37513] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 22:00:40,609 INFO [Listener at jenkins-hbase20.apache.org/37513] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:40,789 INFO [Listener at jenkins-hbase20.apache.org/37513] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:40,889 INFO [Listener at jenkins-hbase20.apache.org/37513] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:40,899 INFO [Listener at jenkins-hbase20.apache.org/37513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:39889 2023-09-23 22:00:41,365 WARN [Listener at jenkins-hbase20.apache.org/46469] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 22:00:41,397 WARN [Listener at jenkins-hbase20.apache.org/46469] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 22:00:41,398 INFO [Listener at jenkins-hbase20.apache.org/46469] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 22:00:41,406 INFO [Listener at jenkins-hbase20.apache.org/46469] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_36817_node____.ast05v/webapp 2023-09-23 22:00:41,457 INFO [Listener at jenkins-hbase20.apache.org/46469] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-23 22:00:41,457 INFO [Listener at jenkins-hbase20.apache.org/46469] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 22:00:41,457 INFO [Listener at jenkins-hbase20.apache.org/46469] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 22:00:41,457 INFO [Listener at jenkins-hbase20.apache.org/46469] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 22:00:41,465 INFO [Listener at jenkins-hbase20.apache.org/46469] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:41,484 INFO [Listener at jenkins-hbase20.apache.org/46469] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:41,545 INFO [Listener at jenkins-hbase20.apache.org/46469] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:41,554 INFO [Listener at jenkins-hbase20.apache.org/46469] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:36817 2023-09-23 22:00:41,747 WARN [Listener at jenkins-hbase20.apache.org/38553] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 22:00:41,753 WARN [Listener at jenkins-hbase20.apache.org/38553] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 22:00:41,753 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 22:00:41,762 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_35399_node____.l5p071/webapp 2023-09-23 22:00:41,817 INFO [Listener at jenkins-hbase20.apache.org/38553] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-23 22:00:41,817 INFO [Listener at jenkins-hbase20.apache.org/38553] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 22:00:41,817 INFO [Listener at jenkins-hbase20.apache.org/38553] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 22:00:41,817 INFO [Listener at jenkins-hbase20.apache.org/38553] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 22:00:41,826 INFO [Listener at jenkins-hbase20.apache.org/38553] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:41,839 INFO [Listener at jenkins-hbase20.apache.org/38553] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:41,892 INFO [Listener at jenkins-hbase20.apache.org/38553] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 22:00:41,898 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:35399 2023-09-23 22:00:41,922 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-23 22:00:41,923 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:00:41,987 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=163, AvailableMemoryMB=8387 2023-09-23 22:00:41,987 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-09-23 22:00:42,000 DEBUG [Listener at jenkins-hbase20.apache.org/38553] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-23 22:00:42,005 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-23 22:00:42,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 22:00:42,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-23 22:00:42,017 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 22:00:42,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-23 22:00:42,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 22:00:42,021 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 22:00:42,027 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:42,027 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:42,029 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700 empty. 2023-09-23 22:00:42,029 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620 empty. 2023-09-23 22:00:42,033 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:42,033 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:42,033 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-23 22:00:42,067 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-23 22:00:42,069 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => b46bc3929980020e090a80fcf402d620, NAME => 'testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:00:42,069 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e181aa5d498019ebb2b96c5c78a3a700, NAME => 'testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:00:42,105 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:42,106 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing b46bc3929980020e090a80fcf402d620, disabling compactions & flushes 2023-09-23 22:00:42,109 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:42,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:42,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. after waiting 0 ms 2023-09-23 22:00:42,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:42,109 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:42,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for b46bc3929980020e090a80fcf402d620: 2023-09-23 22:00:42,110 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:42,111 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e181aa5d498019ebb2b96c5c78a3a700, disabling compactions & flushes 2023-09-23 22:00:42,111 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:42,111 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:42,111 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. after waiting 0 ms 2023-09-23 22:00:42,111 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:42,111 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:42,111 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e181aa5d498019ebb2b96c5c78a3a700: 2023-09-23 22:00:42,114 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 22:00:42,115 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506442115"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506442115"}]},"ts":"1695506442115"} 2023-09-23 22:00:42,116 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506442115"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506442115"}]},"ts":"1695506442115"} 2023-09-23 22:00:42,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 22:00:42,145 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 22:00:42,186 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 22:00:42,188 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 22:00:42,188 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506442188"}]},"ts":"1695506442188"} 2023-09-23 22:00:42,190 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-23 22:00:42,196 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:00:42,200 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:00:42,200 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:00:42,200 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:00:42,200 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:00:42,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e181aa5d498019ebb2b96c5c78a3a700, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b46bc3929980020e090a80fcf402d620, ASSIGN}] 2023-09-23 22:00:42,208 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b46bc3929980020e090a80fcf402d620, ASSIGN 2023-09-23 22:00:42,208 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e181aa5d498019ebb2b96c5c78a3a700, ASSIGN 2023-09-23 22:00:42,211 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e181aa5d498019ebb2b96c5c78a3a700, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45419,1695506434840; forceNewPlan=false, retain=false 2023-09-23 22:00:42,211 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b46bc3929980020e090a80fcf402d620, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44169,1695506434796; forceNewPlan=false, retain=false 2023-09-23 22:00:42,294 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-23 22:00:42,296 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-23 22:00:42,297 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-23 22:00:42,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 22:00:42,361 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 22:00:42,364 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b46bc3929980020e090a80fcf402d620, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:42,364 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e181aa5d498019ebb2b96c5c78a3a700, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:42,364 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506442364"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506442364"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506442364"}]},"ts":"1695506442364"} 2023-09-23 22:00:42,364 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506442364"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506442364"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506442364"}]},"ts":"1695506442364"} 2023-09-23 22:00:42,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure e181aa5d498019ebb2b96c5c78a3a700, server=jenkins-hbase20.apache.org,45419,1695506434840}] 2023-09-23 22:00:42,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure b46bc3929980020e090a80fcf402d620, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:00:42,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:42,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b46bc3929980020e090a80fcf402d620, NAME => 'testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 22:00:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e181aa5d498019ebb2b96c5c78a3a700, NAME => 'testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 22:00:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. service=AccessControlService 2023-09-23 22:00:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. service=AccessControlService 2023-09-23 22:00:42,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:42,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:42,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:42,530 INFO [StoreOpener-b46bc3929980020e090a80fcf402d620-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:42,530 INFO [StoreOpener-e181aa5d498019ebb2b96c5c78a3a700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:42,532 DEBUG [StoreOpener-e181aa5d498019ebb2b96c5c78a3a700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/cf 2023-09-23 22:00:42,532 DEBUG [StoreOpener-e181aa5d498019ebb2b96c5c78a3a700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/cf 2023-09-23 22:00:42,532 DEBUG [StoreOpener-b46bc3929980020e090a80fcf402d620-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/cf 2023-09-23 22:00:42,532 DEBUG [StoreOpener-b46bc3929980020e090a80fcf402d620-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/cf 2023-09-23 22:00:42,535 INFO [StoreOpener-e181aa5d498019ebb2b96c5c78a3a700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e181aa5d498019ebb2b96c5c78a3a700 columnFamilyName cf 2023-09-23 22:00:42,535 INFO [StoreOpener-b46bc3929980020e090a80fcf402d620-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b46bc3929980020e090a80fcf402d620 columnFamilyName cf 2023-09-23 22:00:42,538 INFO [StoreOpener-b46bc3929980020e090a80fcf402d620-1] regionserver.HStore(310): Store=b46bc3929980020e090a80fcf402d620/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:42,538 INFO [StoreOpener-e181aa5d498019ebb2b96c5c78a3a700-1] regionserver.HStore(310): Store=e181aa5d498019ebb2b96c5c78a3a700/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:42,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:42,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:42,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:42,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:42,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:42,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:42,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:00:42,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:00:42,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e181aa5d498019ebb2b96c5c78a3a700; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71439011, jitterRate=0.06452421844005585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:00:42,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e181aa5d498019ebb2b96c5c78a3a700: 2023-09-23 22:00:42,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b46bc3929980020e090a80fcf402d620; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59492105, jitterRate=-0.11349855363368988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:00:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b46bc3929980020e090a80fcf402d620: 2023-09-23 22:00:42,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700., pid=15, masterSystemTime=1695506442520 2023-09-23 22:00:42,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620., pid=16, masterSystemTime=1695506442521 2023-09-23 22:00:42,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:42,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:42,560 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e181aa5d498019ebb2b96c5c78a3a700, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:42,561 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506442560"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506442560"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506442560"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506442560"}]},"ts":"1695506442560"} 2023-09-23 22:00:42,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:42,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:42,563 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b46bc3929980020e090a80fcf402d620, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:42,565 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506442563"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506442563"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506442563"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506442563"}]},"ts":"1695506442563"} 2023-09-23 22:00:42,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-23 22:00:42,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure e181aa5d498019ebb2b96c5c78a3a700, server=jenkins-hbase20.apache.org,45419,1695506434840 in 198 msec 2023-09-23 22:00:42,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-23 22:00:42,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure b46bc3929980020e090a80fcf402d620, server=jenkins-hbase20.apache.org,44169,1695506434796 in 198 msec 2023-09-23 22:00:42,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e181aa5d498019ebb2b96c5c78a3a700, ASSIGN in 369 msec 2023-09-23 22:00:42,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-23 22:00:42,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b46bc3929980020e090a80fcf402d620, ASSIGN in 372 msec 2023-09-23 22:00:42,576 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 22:00:42,577 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506442576"}]},"ts":"1695506442576"} 2023-09-23 22:00:42,579 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-23 22:00:42,582 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 22:00:42,587 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-23 22:00:42,593 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:42,597 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:42,601 DEBUG [hconnection-0x342ce6b1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:42,604 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-09-23 22:00:42,614 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 22:00:42,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 22:00:42,640 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:42,640 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:42,640 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:42,640 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:42,640 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:00:42,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 22:00:42,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 22:00:42,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 22:00:42,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 22:00:42,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 636 msec 2023-09-23 22:00:43,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 22:00:43,128 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-23 22:00:43,132 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-23 22:00:43,133 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:43,135 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:00:43,157 DEBUG [hconnection-0xbee159b-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:43,160 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:43,163 DEBUG [hconnection-0xbee159b-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:43,166 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:43,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 22:00:43,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506443179 (current time:1695506443179). 2023-09-23 22:00:43,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:00:43,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x7121f6d6 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:43,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ef970c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:43,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:43,191 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:43,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7121f6d6 to 127.0.0.1:58910 2023-09-23 22:00:43,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:00:43,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x18ca7b2d to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:43,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ee22471, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:43,203 DEBUG [hconnection-0x4d14cf6b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:43,205 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:43,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:43,212 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:43,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18ca7b2d to 127.0.0.1:58910 2023-09-23 22:00:43,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:00:43,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 22:00:43,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:00:43,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 22:00:43,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 22:00:43,254 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 22:00:43,255 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695507043255 2023-09-23 22:00:43,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 22:00:43,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-23 22:00:43,259 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 22:00:43,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 22:00:43,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-23 22:00:43,263 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 22:00:43,264 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695507043264 2023-09-23 22:00:43,264 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:00:43,264 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:00:43,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,291 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-23 22:00:43,291 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:43,292 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-23 22:00:43,292 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-23 22:00:43,293 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,293 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,295 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:43,295 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:43,295 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:43,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:43,295 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:43,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:43,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:43,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:43,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:43,295 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,295 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,296 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,296 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 22:00:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,298 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 22:00:43,298 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 22:00:43,298 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 22:00:43,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,302 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,302 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 22:00:43,302 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 22:00:43,302 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:43,302 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 22:00:43,303 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:43,303 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 22:00:43,304 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 22:00:43,302 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:43,304 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 22:00:43,304 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 22:00:43,304 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 22:00:43,304 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 22:00:43,304 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 22:00:43,304 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 22:00:43,304 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 22:00:43,306 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,306 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,307 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,307 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:43,307 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:43,307 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,307 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:43,307 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,307 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:43,307 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,307 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:43,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-23 22:00:43,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@83f505d[Count = 1] remaining members to acquire global barrier 2023-09-23 22:00:43,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:43,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:43,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:43,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:43,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:43,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-23 22:00:43,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@83f505d[Count = 0] remaining members to acquire global barrier 2023-09-23 22:00:43,311 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-23 22:00:43,311 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,313 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,313 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,313 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,314 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 22:00:43,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,314 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,314 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 22:00:43,314 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 22:00:43,314 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 22:00:43,314 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:00:43,314 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,314 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:00:43,315 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:00:43,315 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:00:43,315 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:00:43,315 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:00:43,315 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:43,315 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:43,316 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 22:00:43,316 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:43,316 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 22:00:43,317 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. started... 2023-09-23 22:00:43,317 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. started... 2023-09-23 22:00:43,321 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e181aa5d498019ebb2b96c5c78a3a700: 2023-09-23 22:00:43,321 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b46bc3929980020e090a80fcf402d620: 2023-09-23 22:00:43,321 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,321 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,327 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:00:43,327 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:00:43,330 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:00:43,330 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:00:43,364 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:43,375 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. completed. 2023-09-23 22:00:43,376 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:43,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 22:00:43,376 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:00:43,376 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:00:43,376 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,376 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 22:00:43,376 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:00:43,378 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:00:43,378 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 22:00:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:43,378 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:43,378 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 22:00:43,378 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. completed. 2023-09-23 22:00:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:43,378 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:43,378 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:00:43,378 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:00:43,378 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:00:43,378 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,379 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 22:00:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:43,379 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:00:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,380 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,380 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 22:00:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,380 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:43,380 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 22:00:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,45419,1695506434840': 2023-09-23 22:00:43,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-23 22:00:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:43,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:43,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:43,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:00:43,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-23 22:00:43,388 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-23 22:00:43,388 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:00:43,388 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:00:43,388 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,388 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:00:43,397 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:43,398 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:43,398 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,397 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:43,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:43,398 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:43,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,399 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,399 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:43,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,404 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:43,404 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,405 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,417 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,417 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:43,417 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:43,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:43,417 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:43,417 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:43,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:43,417 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:43,417 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:43,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:43,417 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:43,417 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:43,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:43,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:43,418 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,418 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,418 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:43,418 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:43,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:43,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:43,419 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,418 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-23 22:00:43,419 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,420 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,420 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,420 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:00:43,420 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 22:00:43,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-23 22:00:43,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,495 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:43,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695506443256Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695506443440 (+184 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695506443440Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695506443440Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695506443454 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695506443481 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695506443494 (+13 ms) 2023-09-23 22:00:43,497 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 22:00:43,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 239 msec 2023-09-23 22:00:43,579 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:43,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 22:00:43,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:00:43,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45419] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:00:43,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44169] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:00:43,604 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-23 22:00:43,604 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:43,605 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:00:43,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 22:00:43,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506443622 (current time:1695506443622). 2023-09-23 22:00:43,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:00:43,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x10005f87 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:43,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10a5fd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:43,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:43,634 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:43,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10005f87 to 127.0.0.1:58910 2023-09-23 22:00:43,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:00:43,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x11d4b6fa to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:43,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33a3f20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:43,644 DEBUG [hconnection-0x501d347e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:43,647 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:43,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:43,654 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:43,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11d4b6fa to 127.0.0.1:58910 2023-09-23 22:00:43,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:00:43,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 22:00:43,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:00:43,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 22:00:43,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 22:00:43,660 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 22:00:43,661 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695507043661 2023-09-23 22:00:43,661 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-23 22:00:43,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 22:00:43,663 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:00:43,663 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:00:43,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 22:00:43,665 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 22:00:43,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-23 22:00:43,668 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 22:00:43,669 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695507043669 2023-09-23 22:00:43,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-23 22:00:43,685 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-23 22:00:43,686 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:43,687 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-23 22:00:43,687 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-23 22:00:43,687 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,687 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,688 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:43,688 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,688 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:43,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:43,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:43,688 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:43,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:43,689 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:43,689 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,689 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,689 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:00:43,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 22:00:43,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,690 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 22:00:43,690 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 22:00:43,690 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 22:00:43,694 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 22:00:43,694 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 22:00:43,690 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 22:00:43,694 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 22:00:43,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 22:00:43,694 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:43,694 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 22:00:43,695 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 22:00:43,695 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:43,695 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 22:00:43,696 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 22:00:43,696 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 22:00:43,696 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 22:00:43,696 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 22:00:43,705 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,705 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,706 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,706 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,706 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,706 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:43,706 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:43,706 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,706 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:43,706 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,706 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 22:00:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:43,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-23 22:00:43,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12081f29[Count = 1] remaining members to acquire global barrier 2023-09-23 22:00:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 22:00:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:43,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-23 22:00:43,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12081f29[Count = 0] remaining members to acquire global barrier 2023-09-23 22:00:43,710 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-23 22:00:43,710 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,715 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,715 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,715 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,715 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,715 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 22:00:43,715 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 22:00:43,715 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 22:00:43,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,715 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:00:43,716 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:00:43,716 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:00:43,716 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:43,716 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:00:43,716 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:43,716 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 22:00:43,716 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. started... 2023-09-23 22:00:43,716 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:00:43,716 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:43,716 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:00:43,716 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. started... 2023-09-23 22:00:43,716 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b46bc3929980020e090a80fcf402d620 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-23 22:00:43,716 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e181aa5d498019ebb2b96c5c78a3a700 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-23 22:00:43,718 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 22:00:43,718 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:43,718 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 22:00:43,764 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:43,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 22:00:43,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:00:43,765 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:00:43,860 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092322afcdfd4a1445dca17f71b96f434d4b to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092322afcdfd4a1445dca17f71b96f434d4b 2023-09-23 22:00:43,860 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309237d4b9ea4f4784477bd57ff3294e1f322 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309237d4b9ea4f4784477bd57ff3294e1f322 2023-09-23 22:00:43,888 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/.tmp/cf/076a364b8a764a46a78fef62afbb9319 2023-09-23 22:00:43,888 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/.tmp/cf/6504e6e292094772af93eae97709ced7 2023-09-23 22:00:43,900 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/.tmp/cf/6504e6e292094772af93eae97709ced7 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/cf/6504e6e292094772af93eae97709ced7 2023-09-23 22:00:43,900 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/.tmp/cf/076a364b8a764a46a78fef62afbb9319 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/cf/076a364b8a764a46a78fef62afbb9319 2023-09-23 22:00:43,909 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/cf/076a364b8a764a46a78fef62afbb9319, entries=4, sequenceid=6, filesize=5.6 K 2023-09-23 22:00:43,909 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/cf/6504e6e292094772af93eae97709ced7, entries=46, sequenceid=6, filesize=12.6 K 2023-09-23 22:00:43,911 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:00:43,913 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-23 22:00:43,913 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:00:43,913 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-23 22:00:43,914 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-23 22:00:43,914 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-23 22:00:43,914 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:00:43,914 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-23 22:00:43,914 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-23 22:00:43,914 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-23 22:00:43,915 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for b46bc3929980020e090a80fcf402d620 in 199ms, sequenceid=6, compaction requested=false 2023-09-23 22:00:43,915 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-23 22:00:43,915 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for e181aa5d498019ebb2b96c5c78a3a700 in 199ms, sequenceid=6, compaction requested=false 2023-09-23 22:00:43,915 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-23 22:00:43,918 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e181aa5d498019ebb2b96c5c78a3a700: 2023-09-23 22:00:43,918 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b46bc3929980020e090a80fcf402d620: 2023-09-23 22:00:43,919 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 22:00:43,919 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 22:00:43,919 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:00:43,919 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:00:43,919 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/cf/076a364b8a764a46a78fef62afbb9319] hfiles 2023-09-23 22:00:43,919 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/cf/6504e6e292094772af93eae97709ced7] hfiles 2023-09-23 22:00:43,919 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/cf/076a364b8a764a46a78fef62afbb9319 for snapshot=snaptb0-testExportWithTargetName 2023-09-23 22:00:43,919 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/cf/6504e6e292094772af93eae97709ced7 for snapshot=snaptb0-testExportWithTargetName 2023-09-23 22:00:43,946 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. completed. 2023-09-23 22:00:43,946 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:43,946 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:00:43,946 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:00:43,946 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,946 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 22:00:43,946 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:00:43,948 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 22:00:43,948 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,948 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,948 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 22:00:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:43,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:43,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 22:00:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:43,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:43,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 22:00:43,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:43,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:43,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,45419,1695506434840': 2023-09-23 22:00:43,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-23 22:00:43,965 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:43,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 22:00:43,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:00:43,967 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-23 22:00:44,267 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:44,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 22:00:44,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:00:44,269 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-23 22:00:44,346 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. completed. 2023-09-23 22:00:44,347 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:44,347 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:00:44,347 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:00:44,347 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,347 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 22:00:44,347 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:00:44,348 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,348 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 22:00:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:44,349 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:44,349 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 22:00:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 22:00:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 22:00:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:00:44,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-23 22:00:44,355 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-23 22:00:44,355 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:00:44,355 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:00:44,355 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-23 22:00:44,355 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:00:44,357 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,357 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,357 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:44,357 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,357 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,357 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:44,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:44,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:44,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:44,357 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:44,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:44,358 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:44,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:44,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:44,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:44,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:44,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,358 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:44,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:44,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 22:00:44,359 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:44,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 22:00:44,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,361 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:44,361 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:44,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 22:00:44,362 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:44,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,372 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:44,372 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:44,373 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:44,372 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:44,373 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:44,373 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-23 22:00:44,373 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,373 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:44,374 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:44,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-23 22:00:44,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:44,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 22:00:44,374 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:44,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:00:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:44,374 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:44,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:44,374 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:44,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:44,375 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:44,375 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:44,375 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,375 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:44,375 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:44,375 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:44,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:44,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:44,375 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:44,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:44,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092322afcdfd4a1445dca17f71b96f434d4b, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309237d4b9ea4f4784477bd57ff3294e1f322] mob files 2023-09-23 22:00:44,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092322afcdfd4a1445dca17f71b96f434d4b 2023-09-23 22:00:44,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309237d4b9ea4f4784477bd57ff3294e1f322 2023-09-23 22:00:44,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-23 22:00:44,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-23 22:00:44,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,433 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 22:00:44,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695506443662Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695506444390 (+728 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695506444390Loading Region manifests for snaptb0-testExportWithTargetName at 1695506444390Writing data manifest for snaptb0-testExportWithTargetName at 1695506444394 (+4 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695506444420 (+26 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695506444432 (+12 ms) 2023-09-23 22:00:44,434 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 22:00:44,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 772 msec 2023-09-23 22:00:44,769 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:44,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 22:00:44,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:00:44,773 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773 2023-09-23 22:00:44,773 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45753, tgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773, rawTgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773, srcFsUri=hdfs://localhost:45753, srcDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:00:44,806 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:00:44,806 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_783718304_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-23 22:00:44,806 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523, snapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-23 22:00:44,828 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-23 22:00:44,902 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:44,903 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:44,903 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:44,903 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:45,673 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-161436909641762816.jar 2023-09-23 22:00:45,674 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:45,674 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:45,733 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-5336091855969720122.jar 2023-09-23 22:00:45,734 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:45,734 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:45,735 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:45,735 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:45,736 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:45,736 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:45,737 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 22:00:45,737 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 22:00:45,738 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 22:00:45,738 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 22:00:45,739 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 22:00:45,739 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 22:00:45,740 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 22:00:45,740 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 22:00:45,740 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 22:00:45,741 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 22:00:45,744 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:00:45,745 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:00:45,745 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:00:45,746 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:00:45,746 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:00:45,747 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:00:45,747 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:00:46,464 WARN [Listener at jenkins-hbase20.apache.org/38553] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 22:00:46,470 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-23 22:00:46,480 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-23 22:00:46,870 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:00:46,871 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:00:47,052 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0001_000001 (auth:SIMPLE) 2023-09-23 22:00:48,034 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 22:00:50,951 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0001_000001 (auth:SIMPLE) 2023-09-23 22:00:53,182 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0001_000001 (auth:SIMPLE) 2023-09-23 22:00:55,979 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0001_000001 (auth:SIMPLE) 2023-09-23 22:00:55,995 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695506440948_0001_01_000002 is : 143 2023-09-23 22:00:57,291 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 22:00:57,295 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 22:00:57,308 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-23 22:00:57,308 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 22:00:57,309 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 22:00:57,309 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-23 22:00:57,310 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-23 22:00:57,310 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-23 22:00:57,310 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773/.hbase-snapshot/testExportWithTargetName 2023-09-23 22:00:57,311 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-23 22:00:57,311 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506444773/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-23 22:00:57,324 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-23 22:00:57,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-09-23 22:00:57,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-23 22:00:57,347 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506457346"}]},"ts":"1695506457346"} 2023-09-23 22:00:57,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 22:00:57,349 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-23 22:00:57,366 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-23 22:00:57,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e181aa5d498019ebb2b96c5c78a3a700, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b46bc3929980020e090a80fcf402d620, UNASSIGN}] 2023-09-23 22:00:57,371 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e181aa5d498019ebb2b96c5c78a3a700, UNASSIGN 2023-09-23 22:00:57,371 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b46bc3929980020e090a80fcf402d620, UNASSIGN 2023-09-23 22:00:57,373 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e181aa5d498019ebb2b96c5c78a3a700, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:57,373 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b46bc3929980020e090a80fcf402d620, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:57,373 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506457372"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506457372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506457372"}]},"ts":"1695506457372"} 2023-09-23 22:00:57,373 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506457372"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506457372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506457372"}]},"ts":"1695506457372"} 2023-09-23 22:00:57,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure e181aa5d498019ebb2b96c5c78a3a700, server=jenkins-hbase20.apache.org,45419,1695506434840}] 2023-09-23 22:00:57,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure b46bc3929980020e090a80fcf402d620, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:00:57,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 22:00:57,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:57,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:57,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e181aa5d498019ebb2b96c5c78a3a700, disabling compactions & flushes 2023-09-23 22:00:57,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b46bc3929980020e090a80fcf402d620, disabling compactions & flushes 2023-09-23 22:00:57,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:57,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:57,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:57,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. after waiting 0 ms 2023-09-23 22:00:57,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:57,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:57,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. after waiting 0 ms 2023-09-23 22:00:57,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:57,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:00:57,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:00:57,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:00:57,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:00:57,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620. 2023-09-23 22:00:57,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700. 2023-09-23 22:00:57,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b46bc3929980020e090a80fcf402d620: 2023-09-23 22:00:57,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e181aa5d498019ebb2b96c5c78a3a700: 2023-09-23 22:00:57,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:57,560 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e181aa5d498019ebb2b96c5c78a3a700, regionState=CLOSED 2023-09-23 22:00:57,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506457560"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506457560"}]},"ts":"1695506457560"} 2023-09-23 22:00:57,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:57,561 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b46bc3929980020e090a80fcf402d620, regionState=CLOSED 2023-09-23 22:00:57,561 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695506457561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506457561"}]},"ts":"1695506457561"} 2023-09-23 22:00:57,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-23 22:00:57,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-23 22:00:57,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure e181aa5d498019ebb2b96c5c78a3a700, server=jenkins-hbase20.apache.org,45419,1695506434840 in 187 msec 2023-09-23 22:00:57,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure b46bc3929980020e090a80fcf402d620, server=jenkins-hbase20.apache.org,44169,1695506434796 in 187 msec 2023-09-23 22:00:57,568 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e181aa5d498019ebb2b96c5c78a3a700, UNASSIGN in 199 msec 2023-09-23 22:00:57,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-23 22:00:57,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b46bc3929980020e090a80fcf402d620, UNASSIGN in 199 msec 2023-09-23 22:00:57,570 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506457570"}]},"ts":"1695506457570"} 2023-09-23 22:00:57,572 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-23 22:00:57,573 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-23 22:00:57,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 240 msec 2023-09-23 22:00:57,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 22:00:57,651 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-23 22:00:57,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-09-23 22:00:57,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 22:00:57,666 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 22:00:57,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-23 22:00:57,668 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 22:00:57,671 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-23 22:00:57,673 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 22:00:57,673 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 22:00:57,673 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 22:00:57,673 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 22:00:57,674 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:57,674 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:57,674 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:57,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 22:00:57,674 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 22:00:57,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 22:00:57,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 22:00:57,674 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:57,674 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 22:00:57,674 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 22:00:57,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 22:00:57,674 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 22:00:57,676 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:57,676 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:57,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-23 22:00:57,679 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/recovered.edits] 2023-09-23 22:00:57,679 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/recovered.edits] 2023-09-23 22:00:57,687 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/cf/6504e6e292094772af93eae97709ced7 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/cf/6504e6e292094772af93eae97709ced7 2023-09-23 22:00:57,687 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/cf/076a364b8a764a46a78fef62afbb9319 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/cf/076a364b8a764a46a78fef62afbb9319 2023-09-23 22:00:57,691 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700/recovered.edits/9.seqid 2023-09-23 22:00:57,691 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620/recovered.edits/9.seqid 2023-09-23 22:00:57,692 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/e181aa5d498019ebb2b96c5c78a3a700 2023-09-23 22:00:57,692 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportWithTargetName/b46bc3929980020e090a80fcf402d620 2023-09-23 22:00:57,692 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-23 22:00:57,692 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-23 22:00:57,693 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-23 22:00:57,697 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092322afcdfd4a1445dca17f71b96f434d4b to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092322afcdfd4a1445dca17f71b96f434d4b 2023-09-23 22:00:57,699 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309237d4b9ea4f4784477bd57ff3294e1f322 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309237d4b9ea4f4784477bd57ff3294e1f322 2023-09-23 22:00:57,699 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-23 22:00:57,702 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 22:00:57,722 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-23 22:00:57,724 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-23 22:00:57,726 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 22:00:57,726 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-23 22:00:57,727 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506457727"}]},"ts":"9223372036854775807"} 2023-09-23 22:00:57,727 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506457727"}]},"ts":"9223372036854775807"} 2023-09-23 22:00:57,729 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 22:00:57,730 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e181aa5d498019ebb2b96c5c78a3a700, NAME => 'testtb-testExportWithTargetName,,1695506442011.e181aa5d498019ebb2b96c5c78a3a700.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b46bc3929980020e090a80fcf402d620, NAME => 'testtb-testExportWithTargetName,1,1695506442011.b46bc3929980020e090a80fcf402d620.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 22:00:57,730 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-23 22:00:57,730 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695506457730"}]},"ts":"9223372036854775807"} 2023-09-23 22:00:57,732 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-23 22:00:57,734 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 22:00:57,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-09-23 22:00:57,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-23 22:00:57,780 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-23 22:00:57,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-23 22:00:57,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-23 22:00:57,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-09-23 22:00:57,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-23 22:00:57,833 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=758 (was 704) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase20.apache.org/148.251.75.209:35593 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:48272 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:58892 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403139988_1 at /127.0.0.1:51610 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:51634 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase20.apache.org/148.251.75.209:38553 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase20.apache.org/148.251.75.209:43939 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-403139988_1 at /127.0.0.1:58882 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase20.apache.org/148.251.75.209:46469 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=940 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 190) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 163) - ProcessCount LEAK? -, AvailableMemoryMB=7611 (was 8387) 2023-09-23 22:00:57,834 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-23 22:00:57,850 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=758, OpenFileDescriptor=940, MaxFileDescriptor=60000, SystemLoadAverage=262, ProcessCount=166, AvailableMemoryMB=7611 2023-09-23 22:00:57,850 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-23 22:00:57,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 22:00:57,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-23 22:00:57,858 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 22:00:57,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-23 22:00:57,861 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 22:00:57,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 22:00:57,864 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:00:57,864 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:00:57,865 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0 empty. 2023-09-23 22:00:57,865 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806 empty. 2023-09-23 22:00:57,865 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:00:57,865 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:00:57,865 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-23 22:00:57,878 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-23 22:00:57,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5c35edde77f4bb6e4ef52b982ee88bb0, NAME => 'testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:00:57,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 03fef7346a4ae48d8e564e86a11c8806, NAME => 'testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:00:57,896 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:57,896 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:57,897 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 03fef7346a4ae48d8e564e86a11c8806, disabling compactions & flushes 2023-09-23 22:00:57,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5c35edde77f4bb6e4ef52b982ee88bb0, disabling compactions & flushes 2023-09-23 22:00:57,898 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:57,898 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:57,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:57,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:57,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. after waiting 0 ms 2023-09-23 22:00:57,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. after waiting 0 ms 2023-09-23 22:00:57,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:57,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:57,898 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:57,898 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:57,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 03fef7346a4ae48d8e564e86a11c8806: 2023-09-23 22:00:57,898 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5c35edde77f4bb6e4ef52b982ee88bb0: 2023-09-23 22:00:57,902 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 22:00:57,903 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506457903"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506457903"}]},"ts":"1695506457903"} 2023-09-23 22:00:57,903 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506457903"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506457903"}]},"ts":"1695506457903"} 2023-09-23 22:00:57,906 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 22:00:57,908 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 22:00:57,908 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506457908"}]},"ts":"1695506457908"} 2023-09-23 22:00:57,910 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-23 22:00:57,912 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:00:57,914 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:00:57,914 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:00:57,914 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:00:57,914 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:00:57,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c35edde77f4bb6e4ef52b982ee88bb0, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=03fef7346a4ae48d8e564e86a11c8806, ASSIGN}] 2023-09-23 22:00:57,917 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=03fef7346a4ae48d8e564e86a11c8806, ASSIGN 2023-09-23 22:00:57,918 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c35edde77f4bb6e4ef52b982ee88bb0, ASSIGN 2023-09-23 22:00:57,919 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=03fef7346a4ae48d8e564e86a11c8806, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38977,1695506434881; forceNewPlan=false, retain=false 2023-09-23 22:00:57,919 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c35edde77f4bb6e4ef52b982ee88bb0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44169,1695506434796; forceNewPlan=false, retain=false 2023-09-23 22:00:57,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 22:00:58,069 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 22:00:58,072 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=03fef7346a4ae48d8e564e86a11c8806, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,072 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5c35edde77f4bb6e4ef52b982ee88bb0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,072 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506458072"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506458072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506458072"}]},"ts":"1695506458072"} 2023-09-23 22:00:58,073 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506458072"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506458072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506458072"}]},"ts":"1695506458072"} 2023-09-23 22:00:58,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 5c35edde77f4bb6e4ef52b982ee88bb0, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:00:58,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 03fef7346a4ae48d8e564e86a11c8806, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:00:58,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 22:00:58,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:58,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5c35edde77f4bb6e4ef52b982ee88bb0, NAME => 'testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 22:00:58,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. service=AccessControlService 2023-09-23 22:00:58,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:58,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:00:58,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:58,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:58,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03fef7346a4ae48d8e564e86a11c8806, NAME => 'testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 22:00:58,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:00:58,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:00:58,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. service=AccessControlService 2023-09-23 22:00:58,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:00:58,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:00:58,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:00:58,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:00:58,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:00:58,239 INFO [StoreOpener-5c35edde77f4bb6e4ef52b982ee88bb0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:00:58,239 INFO [StoreOpener-03fef7346a4ae48d8e564e86a11c8806-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:00:58,240 DEBUG [StoreOpener-5c35edde77f4bb6e4ef52b982ee88bb0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/cf 2023-09-23 22:00:58,240 DEBUG [StoreOpener-5c35edde77f4bb6e4ef52b982ee88bb0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/cf 2023-09-23 22:00:58,241 DEBUG [StoreOpener-03fef7346a4ae48d8e564e86a11c8806-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/cf 2023-09-23 22:00:58,241 DEBUG [StoreOpener-03fef7346a4ae48d8e564e86a11c8806-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/cf 2023-09-23 22:00:58,241 INFO [StoreOpener-5c35edde77f4bb6e4ef52b982ee88bb0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c35edde77f4bb6e4ef52b982ee88bb0 columnFamilyName cf 2023-09-23 22:00:58,241 INFO [StoreOpener-03fef7346a4ae48d8e564e86a11c8806-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03fef7346a4ae48d8e564e86a11c8806 columnFamilyName cf 2023-09-23 22:00:58,242 INFO [StoreOpener-03fef7346a4ae48d8e564e86a11c8806-1] regionserver.HStore(310): Store=03fef7346a4ae48d8e564e86a11c8806/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:58,242 INFO [StoreOpener-5c35edde77f4bb6e4ef52b982ee88bb0-1] regionserver.HStore(310): Store=5c35edde77f4bb6e4ef52b982ee88bb0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:00:58,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:00:58,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:00:58,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:00:58,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:00:58,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:00:58,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:00:58,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:00:58,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:00:58,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 03fef7346a4ae48d8e564e86a11c8806; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67986576, jitterRate=0.013078927993774414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:00:58,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5c35edde77f4bb6e4ef52b982ee88bb0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63065040, jitterRate=-0.060257673263549805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:00:58,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 03fef7346a4ae48d8e564e86a11c8806: 2023-09-23 22:00:58,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5c35edde77f4bb6e4ef52b982ee88bb0: 2023-09-23 22:00:58,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0., pid=30, masterSystemTime=1695506458227 2023-09-23 22:00:58,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806., pid=31, masterSystemTime=1695506458228 2023-09-23 22:00:58,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:58,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:58,261 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5c35edde77f4bb6e4ef52b982ee88bb0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:58,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:58,262 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506458261"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506458261"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506458261"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506458261"}]},"ts":"1695506458261"} 2023-09-23 22:00:58,262 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=03fef7346a4ae48d8e564e86a11c8806, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,263 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506458262"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506458262"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506458262"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506458262"}]},"ts":"1695506458262"} 2023-09-23 22:00:58,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-23 22:00:58,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 5c35edde77f4bb6e4ef52b982ee88bb0, server=jenkins-hbase20.apache.org,44169,1695506434796 in 189 msec 2023-09-23 22:00:58,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-23 22:00:58,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 03fef7346a4ae48d8e564e86a11c8806, server=jenkins-hbase20.apache.org,38977,1695506434881 in 190 msec 2023-09-23 22:00:58,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c35edde77f4bb6e4ef52b982ee88bb0, ASSIGN in 357 msec 2023-09-23 22:00:58,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-23 22:00:58,278 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=03fef7346a4ae48d8e564e86a11c8806, ASSIGN in 360 msec 2023-09-23 22:00:58,279 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 22:00:58,279 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506458279"}]},"ts":"1695506458279"} 2023-09-23 22:00:58,281 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-23 22:00:58,284 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 22:00:58,284 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-23 22:00:58,287 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 22:00:58,297 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:58,297 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:58,297 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:58,297 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:00:58,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 22:00:58,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 22:00:58,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 22:00:58,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 22:00:58,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 444 msec 2023-09-23 22:00:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 22:00:58,465 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-23 22:00:58,468 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-23 22:00:58,468 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:58,470 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:00:58,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:00:58,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506458489 (current time:1695506458489). 2023-09-23 22:00:58,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:00:58,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x1640042e to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:58,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19f7711, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:58,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:58,502 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:58,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1640042e to 127.0.0.1:58910 2023-09-23 22:00:58,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:00:58,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x0f15c6a0 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:58,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1962d218, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:58,516 DEBUG [hconnection-0x63bf09da-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:58,520 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:58,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:58,530 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:58,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f15c6a0 to 127.0.0.1:58910 2023-09-23 22:00:58,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:00:58,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 22:00:58,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:00:58,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:00:58,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:00:58,536 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:00:58,537 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695507058537 2023-09-23 22:00:58,537 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-23 22:00:58,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:00:58,539 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:00:58,539 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:00:58,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 22:00:58,544 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:00:58,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-09-23 22:00:58,547 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 22:00:58,548 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695507058548 2023-09-23 22:00:58,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,562 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-23 22:00:58,562 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:58,563 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-23 22:00:58,563 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-23 22:00:58,564 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,564 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,565 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:58,565 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:58,565 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:58,565 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:58,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:58,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:58,565 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,566 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,566 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,566 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:00:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,567 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 22:00:58,567 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,569 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 22:00:58,569 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 22:00:58,569 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,570 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 22:00:58,570 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 22:00:58,570 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 22:00:58,570 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 22:00:58,569 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 22:00:58,570 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 22:00:58,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,571 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 22:00:58,571 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:58,572 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 22:00:58,572 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 22:00:58,572 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 22:00:58,580 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,583 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,583 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,583 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:58,583 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:58,583 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:58,583 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,584 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:58,583 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,584 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,584 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:58,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-23 22:00:58,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60a247d0[Count = 1] remaining members to acquire global barrier 2023-09-23 22:00:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:58,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:58,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-23 22:00:58,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60a247d0[Count = 0] remaining members to acquire global barrier 2023-09-23 22:00:58,587 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 22:00:58,587 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,588 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,588 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,588 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,588 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:00:58,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,588 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,588 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 22:00:58,589 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:00:58,589 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:00:58,589 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,589 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:00:58,589 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:00:58,589 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:00:58,589 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:00:58,589 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:58,589 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:58,589 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:00:58,589 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:00:58,589 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. started... 2023-09-23 22:00:58,589 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. started... 2023-09-23 22:00:58,591 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5c35edde77f4bb6e4ef52b982ee88bb0: 2023-09-23 22:00:58,591 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 03fef7346a4ae48d8e564e86a11c8806: 2023-09-23 22:00:58,591 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 22:00:58,591 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,591 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,591 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:58,591 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:00:58,591 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:00:58,593 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:00:58,591 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 22:00:58,593 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:00:58,617 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. completed. 2023-09-23 22:00:58,617 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:58,617 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:00:58,617 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:00:58,617 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,618 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 22:00:58,618 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:00:58,621 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. completed. 2023-09-23 22:00:58,622 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:58,622 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:00:58,622 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:00:58,622 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,622 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 22:00:58,622 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:00:58,630 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,630 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 22:00:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:58,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:58,630 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:58,630 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 22:00:58,632 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:58,632 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 22:00:58,632 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:58,632 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 22:00:58,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:58,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:58,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:00:58,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 22:00:58,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:58,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:58,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:58,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:58,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:58,639 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:58,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 22:00:58,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:00:58,641 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:00:58,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:00:58,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 22:00:58,642 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-23 22:00:58,642 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:00:58,642 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:00:58,642 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,642 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:00:58,647 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:58,647 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:58,648 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:58,647 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:58,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:58,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:58,648 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:58,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:58,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,649 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:58,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,651 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,651 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:58,652 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,655 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:58,655 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:58,655 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:58,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:58,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:58,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:58,655 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,656 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,655 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:58,656 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-23 22:00:58,655 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:58,656 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:58,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:58,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,656 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:58,658 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:00:58,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:58,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:58,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 22:00:58,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:58,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:58,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-23 22:00:58,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,709 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 22:00:58,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695506458537Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695506458671 (+134 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695506458671Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695506458671Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695506458678 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695506458697 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695506458708 (+11 ms) 2023-09-23 22:00:58,712 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 22:00:58,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 173 msec 2023-09-23 22:00:58,841 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:58,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 22:00:58,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:00:58,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44169] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:00:58,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38977] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:00:58,852 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-23 22:00:58,852 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:58,852 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:00:58,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:00:58,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506458865 (current time:1695506458865). 2023-09-23 22:00:58,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:00:58,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x0ba8082a to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:58,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@445a6cfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:58,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:58,876 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:58,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ba8082a to 127.0.0.1:58910 2023-09-23 22:00:58,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:00:58,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x24589926 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:00:58,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7850a066, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:00:58,886 DEBUG [hconnection-0xa0c9574-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:58,887 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:58,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:00:58,894 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:00:58,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24589926 to 127.0.0.1:58910 2023-09-23 22:00:58,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:00:58,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 22:00:58,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:00:58,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:00:58,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:00:58,900 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:00:58,901 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695507058901 2023-09-23 22:00:58,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:00:58,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-23 22:00:58,903 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:00:58,903 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:00:58,905 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:00:58,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 22:00:58,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-23 22:00:58,907 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 22:00:58,908 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695507058908 2023-09-23 22:00:58,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-23 22:00:58,921 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-23 22:00:58,921 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:58,922 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-23 22:00:58,922 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-23 22:00:58,923 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,923 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,924 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:58,924 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:58,924 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:58,924 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:58,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:58,924 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,924 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:58,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:58,924 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,925 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 22:00:58,925 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 22:00:58,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 22:00:58,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 22:00:58,926 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 22:00:58,926 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:58,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 22:00:58,927 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 22:00:58,927 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 22:00:58,926 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 22:00:58,927 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 22:00:58,927 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 22:00:58,927 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:58,927 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:00:58,928 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 22:00:58,929 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 22:00:58,929 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 22:00:58,929 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 22:00:58,929 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 22:00:58,929 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 22:00:58,939 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,939 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,939 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:58,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:58,939 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,939 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:58,939 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,939 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,939 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:58,939 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:58,940 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,940 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:00:58,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:58,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 22:00:58,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:58,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-23 22:00:58,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3281edba[Count = 1] remaining members to acquire global barrier 2023-09-23 22:00:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:58,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:58,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:58,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 22:00:58,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:58,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:58,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-23 22:00:58,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3281edba[Count = 0] remaining members to acquire global barrier 2023-09-23 22:00:58,943 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 22:00:58,943 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:00:58,947 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 22:00:58,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:58,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:00:58,947 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:00:58,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:58,947 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:00:58,948 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:58,948 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:00:58,948 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 22:00:58,948 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:58,948 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 22:00:58,950 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:58,951 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. started... 2023-09-23 22:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:58,951 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:00:58,951 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. started... 2023-09-23 22:00:58,952 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 03fef7346a4ae48d8e564e86a11c8806 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-23 22:00:58,952 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5c35edde77f4bb6e4ef52b982ee88bb0 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-23 22:00:58,985 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309233693a337644140a0a1e6dcd7b921d495 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309233693a337644140a0a1e6dcd7b921d495 2023-09-23 22:00:58,985 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309231700b35b37df46958aec399d8b57c87a to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309231700b35b37df46958aec399d8b57c87a 2023-09-23 22:00:59,003 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:59,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 22:00:59,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:00:59,011 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:00:59,013 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/.tmp/cf/1b6c547257084cc58c746b19a3bf2266 2023-09-23 22:00:59,015 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/.tmp/cf/2efbeda0733b4171a82c45952c05c3d6 2023-09-23 22:00:59,024 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/.tmp/cf/1b6c547257084cc58c746b19a3bf2266 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/cf/1b6c547257084cc58c746b19a3bf2266 2023-09-23 22:00:59,025 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/.tmp/cf/2efbeda0733b4171a82c45952c05c3d6 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/cf/2efbeda0733b4171a82c45952c05c3d6 2023-09-23 22:00:59,031 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/cf/1b6c547257084cc58c746b19a3bf2266, entries=6, sequenceid=6, filesize=5.9 K 2023-09-23 22:00:59,035 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/cf/2efbeda0733b4171a82c45952c05c3d6, entries=44, sequenceid=6, filesize=12.3 K 2023-09-23 22:00:59,036 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 03fef7346a4ae48d8e564e86a11c8806 in 85ms, sequenceid=6, compaction requested=false 2023-09-23 22:00:59,036 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 5c35edde77f4bb6e4ef52b982ee88bb0 in 84ms, sequenceid=6, compaction requested=false 2023-09-23 22:00:59,036 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-23 22:00:59,036 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-23 22:00:59,039 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 03fef7346a4ae48d8e564e86a11c8806: 2023-09-23 22:00:59,039 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5c35edde77f4bb6e4ef52b982ee88bb0: 2023-09-23 22:00:59,040 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 22:00:59,040 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 22:00:59,040 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:00:59,040 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:00:59,040 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/cf/2efbeda0733b4171a82c45952c05c3d6] hfiles 2023-09-23 22:00:59,040 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/cf/1b6c547257084cc58c746b19a3bf2266] hfiles 2023-09-23 22:00:59,040 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/cf/2efbeda0733b4171a82c45952c05c3d6 for snapshot=snaptb0-testExportFileSystemState 2023-09-23 22:00:59,040 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/cf/1b6c547257084cc58c746b19a3bf2266 for snapshot=snaptb0-testExportFileSystemState 2023-09-23 22:00:59,065 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. completed. 2023-09-23 22:00:59,065 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:00:59,066 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:00:59,066 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:00:59,066 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,066 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 22:00:59,066 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:00:59,069 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 22:00:59,069 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,069 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:59,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:59,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:59,069 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 22:00:59,071 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. completed. 2023-09-23 22:00:59,071 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:00:59,071 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:00:59,071 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:00:59,071 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,071 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 22:00:59,071 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:00:59,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:59,072 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,072 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 22:00:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 22:00:59,072 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:59,073 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 22:00:59,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:59,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 22:00:59,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:00:59,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 22:00:59,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:59,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:59,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 22:00:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 22:00:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:00:59,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 22:00:59,081 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-23 22:00:59,081 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:00:59,081 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:00:59,081 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-23 22:00:59,081 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:00:59,082 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,084 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,084 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:00:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:00:59,082 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,085 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:00:59,085 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:59,084 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:59,085 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 22:00:59,086 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:00:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,086 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 22:00:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:00:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 22:00:59,088 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,088 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,089 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,091 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,091 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,091 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:59,091 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:59,091 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:00:59,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:59,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:59,091 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:59,091 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,091 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:00:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:59,091 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:59,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:00:59,091 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:00:59,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:00:59,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:59,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:59,092 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,092 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-23 22:00:59,093 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-23 22:00:59,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:59,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:00:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:59,094 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:00:59,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 22:00:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:00:59,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:00:59,094 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,094 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:00:59,094 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:00:59,094 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,094 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309233693a337644140a0a1e6dcd7b921d495, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309231700b35b37df46958aec399d8b57c87a] mob files 2023-09-23 22:00:59,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309233693a337644140a0a1e6dcd7b921d495 2023-09-23 22:00:59,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309231700b35b37df46958aec399d8b57c87a 2023-09-23 22:00:59,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-23 22:00:59,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,127 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-23 22:00:59,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,128 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695506458901Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695506459103 (+202 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695506459103Loading Region manifests for snaptb0-testExportFileSystemState at 1695506459103Writing data manifest for snaptb0-testExportFileSystemState at 1695506459106 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695506459116 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695506459127 (+11 ms) 2023-09-23 22:00:59,131 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 22:00:59,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 228 msec 2023-09-23 22:00:59,211 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:00:59,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 22:00:59,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:00:59,212 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212 2023-09-23 22:00:59,213 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45753, tgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212, rawTgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212, srcFsUri=hdfs://localhost:45753, srcDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:00:59,238 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:00:59,239 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-230415384_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,239 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523, snapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-23 22:00:59,255 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 22:00:59,278 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:59,278 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:59,279 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 22:00:59,279 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:00,043 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-5683682963189846089.jar 2023-09-23 22:01:00,044 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:00,044 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:00,102 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-7141833590295088592.jar 2023-09-23 22:01:00,103 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:00,103 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:00,103 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:00,104 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:00,104 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:00,104 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:00,105 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 22:01:00,105 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 22:01:00,106 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 22:01:00,106 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 22:01:00,107 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 22:01:00,108 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 22:01:00,108 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 22:01:00,108 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 22:01:00,109 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 22:01:00,109 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 22:01:00,110 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:00,110 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:00,111 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:00,111 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:00,111 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:00,112 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:00,112 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:00,628 WARN [Listener at jenkins-hbase20.apache.org/38553] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 22:01:00,631 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-23 22:01:00,634 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-23 22:01:02,164 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:01:02,164 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:01:02,169 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0001_000001 (auth:SIMPLE) 2023-09-23 22:01:03,036 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0002_000001 (auth:SIMPLE) 2023-09-23 22:01:03,135 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 22:01:06,570 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0002_000001 (auth:SIMPLE) 2023-09-23 22:01:08,767 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0002_000001 (auth:SIMPLE) 2023-09-23 22:01:10,920 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0002_000001 (auth:SIMPLE) 2023-09-23 22:01:12,854 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 22:01:12,854 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 22:01:12,861 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-23 22:01:12,862 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 22:01:12,862 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 22:01:12,862 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 22:01:12,863 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-23 22:01:12,863 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-23 22:01:12,863 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 22:01:12,864 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-23 22:01:12,864 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506459212/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-23 22:01:12,873 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-23 22:01:12,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-09-23 22:01:12,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-23 22:01:12,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 22:01:12,878 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506472878"}]},"ts":"1695506472878"} 2023-09-23 22:01:12,880 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-23 22:01:12,882 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-23 22:01:12,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c35edde77f4bb6e4ef52b982ee88bb0, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=03fef7346a4ae48d8e564e86a11c8806, UNASSIGN}] 2023-09-23 22:01:12,885 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c35edde77f4bb6e4ef52b982ee88bb0, UNASSIGN 2023-09-23 22:01:12,885 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=03fef7346a4ae48d8e564e86a11c8806, UNASSIGN 2023-09-23 22:01:12,886 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=03fef7346a4ae48d8e564e86a11c8806, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:12,886 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5c35edde77f4bb6e4ef52b982ee88bb0, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:12,886 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506472886"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506472886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506472886"}]},"ts":"1695506472886"} 2023-09-23 22:01:12,886 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506472886"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506472886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506472886"}]},"ts":"1695506472886"} 2023-09-23 22:01:12,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 03fef7346a4ae48d8e564e86a11c8806, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:01:12,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 5c35edde77f4bb6e4ef52b982ee88bb0, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:01:12,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 22:01:13,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:01:13,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:01:13,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5c35edde77f4bb6e4ef52b982ee88bb0, disabling compactions & flushes 2023-09-23 22:01:13,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:01:13,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:01:13,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 03fef7346a4ae48d8e564e86a11c8806, disabling compactions & flushes 2023-09-23 22:01:13,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. after waiting 0 ms 2023-09-23 22:01:13,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:01:13,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:01:13,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:01:13,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. after waiting 0 ms 2023-09-23 22:01:13,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:01:13,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:01:13,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:01:13,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:01:13,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:01:13,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806. 2023-09-23 22:01:13,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0. 2023-09-23 22:01:13,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 03fef7346a4ae48d8e564e86a11c8806: 2023-09-23 22:01:13,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5c35edde77f4bb6e4ef52b982ee88bb0: 2023-09-23 22:01:13,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:01:13,060 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5c35edde77f4bb6e4ef52b982ee88bb0, regionState=CLOSED 2023-09-23 22:01:13,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:01:13,060 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506473060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506473060"}]},"ts":"1695506473060"} 2023-09-23 22:01:13,061 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=03fef7346a4ae48d8e564e86a11c8806, regionState=CLOSED 2023-09-23 22:01:13,061 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695506473061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506473061"}]},"ts":"1695506473061"} 2023-09-23 22:01:13,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-23 22:01:13,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 5c35edde77f4bb6e4ef52b982ee88bb0, server=jenkins-hbase20.apache.org,44169,1695506434796 in 173 msec 2023-09-23 22:01:13,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-23 22:01:13,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 03fef7346a4ae48d8e564e86a11c8806, server=jenkins-hbase20.apache.org,38977,1695506434881 in 175 msec 2023-09-23 22:01:13,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5c35edde77f4bb6e4ef52b982ee88bb0, UNASSIGN in 181 msec 2023-09-23 22:01:13,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-23 22:01:13,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=03fef7346a4ae48d8e564e86a11c8806, UNASSIGN in 182 msec 2023-09-23 22:01:13,072 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506473072"}]},"ts":"1695506473072"} 2023-09-23 22:01:13,073 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-23 22:01:13,174 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-23 22:01:13,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 303 msec 2023-09-23 22:01:13,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 22:01:13,182 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-23 22:01:13,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-09-23 22:01:13,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 22:01:13,187 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 22:01:13,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-23 22:01:13,188 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 22:01:13,189 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-23 22:01:13,192 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:01:13,192 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:01:13,194 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/recovered.edits] 2023-09-23 22:01:13,194 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/recovered.edits] 2023-09-23 22:01:13,199 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/cf/1b6c547257084cc58c746b19a3bf2266 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/cf/1b6c547257084cc58c746b19a3bf2266 2023-09-23 22:01:13,200 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/cf/2efbeda0733b4171a82c45952c05c3d6 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/cf/2efbeda0733b4171a82c45952c05c3d6 2023-09-23 22:01:13,203 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0/recovered.edits/9.seqid 2023-09-23 22:01:13,203 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806/recovered.edits/9.seqid 2023-09-23 22:01:13,204 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/5c35edde77f4bb6e4ef52b982ee88bb0 2023-09-23 22:01:13,204 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemState/03fef7346a4ae48d8e564e86a11c8806 2023-09-23 22:01:13,204 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-23 22:01:13,205 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-23 22:01:13,205 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-23 22:01:13,209 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309233693a337644140a0a1e6dcd7b921d495 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309233693a337644140a0a1e6dcd7b921d495 2023-09-23 22:01:13,210 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309231700b35b37df46958aec399d8b57c87a to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309231700b35b37df46958aec399d8b57c87a 2023-09-23 22:01:13,210 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-23 22:01:13,213 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 22:01:13,215 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-23 22:01:13,217 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-23 22:01:13,219 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 22:01:13,219 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-23 22:01:13,219 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506473219"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:13,219 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506473219"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:13,221 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 22:01:13,221 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5c35edde77f4bb6e4ef52b982ee88bb0, NAME => 'testtb-testExportFileSystemState,,1695506457852.5c35edde77f4bb6e4ef52b982ee88bb0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 03fef7346a4ae48d8e564e86a11c8806, NAME => 'testtb-testExportFileSystemState,1,1695506457852.03fef7346a4ae48d8e564e86a11c8806.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 22:01:13,222 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-23 22:01:13,222 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695506473222"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:13,224 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-23 22:01:13,569 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 22:01:13,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 385 msec 2023-09-23 22:01:13,595 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 22:01:13,595 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 22:01:13,595 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 22:01:13,595 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 22:01:13,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 22:01:13,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 22:01:13,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 22:01:13,695 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 22:01:13,695 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:13,695 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 22:01:13,695 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 22:01:13,695 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:13,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-09-23 22:01:13,696 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 22:01:13,695 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:13,695 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:13,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-23 22:01:13,697 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-23 22:01:13,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-23 22:01:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-23 22:01:13,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-09-23 22:01:13,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-23 22:01:13,743 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_981709262_1 at /127.0.0.1:53058 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:47708 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:38346 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2081 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase20.apache.org/148.251.75.209:40439 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=927 (was 940), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=233 (was 262), ProcessCount=166 (was 166), AvailableMemoryMB=7402 (was 7611) 2023-09-23 22:01:13,743 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 22:01:13,760 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=233, ProcessCount=166, AvailableMemoryMB=7402 2023-09-23 22:01:13,760 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 22:01:13,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 22:01:13,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-23 22:01:13,765 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 22:01:13,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-23 22:01:13,766 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 22:01:13,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 22:01:13,768 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:13,768 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:13,769 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896 empty. 2023-09-23 22:01:13,769 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43 empty. 2023-09-23 22:01:13,769 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:13,769 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:13,769 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-23 22:01:13,779 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-23 22:01:13,780 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => ba8d0f43c4a1b20ffe193b0c28549896, NAME => 'testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:01:13,780 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0733090a050b89131c92c16d7b27cb43, NAME => 'testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:01:13,793 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:13,793 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 0733090a050b89131c92c16d7b27cb43, disabling compactions & flushes 2023-09-23 22:01:13,793 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:13,793 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:13,793 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. after waiting 0 ms 2023-09-23 22:01:13,793 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:13,793 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:13,793 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 0733090a050b89131c92c16d7b27cb43: 2023-09-23 22:01:13,795 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:13,795 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing ba8d0f43c4a1b20ffe193b0c28549896, disabling compactions & flushes 2023-09-23 22:01:13,795 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:13,795 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:13,795 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. after waiting 0 ms 2023-09-23 22:01:13,795 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:13,796 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:13,796 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for ba8d0f43c4a1b20ffe193b0c28549896: 2023-09-23 22:01:13,798 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 22:01:13,799 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506473799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506473799"}]},"ts":"1695506473799"} 2023-09-23 22:01:13,800 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506473799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506473799"}]},"ts":"1695506473799"} 2023-09-23 22:01:13,802 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 22:01:13,803 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 22:01:13,803 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506473803"}]},"ts":"1695506473803"} 2023-09-23 22:01:13,804 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-23 22:01:13,806 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:01:13,808 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:01:13,808 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:01:13,808 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:01:13,808 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:01:13,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba8d0f43c4a1b20ffe193b0c28549896, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0733090a050b89131c92c16d7b27cb43, ASSIGN}] 2023-09-23 22:01:13,810 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0733090a050b89131c92c16d7b27cb43, ASSIGN 2023-09-23 22:01:13,811 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba8d0f43c4a1b20ffe193b0c28549896, ASSIGN 2023-09-23 22:01:13,811 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba8d0f43c4a1b20ffe193b0c28549896, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38977,1695506434881; forceNewPlan=false, retain=false 2023-09-23 22:01:13,811 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0733090a050b89131c92c16d7b27cb43, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45419,1695506434840; forceNewPlan=false, retain=false 2023-09-23 22:01:13,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 22:01:13,962 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 22:01:13,967 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0733090a050b89131c92c16d7b27cb43, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:13,967 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ba8d0f43c4a1b20ffe193b0c28549896, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:13,968 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506473967"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506473967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506473967"}]},"ts":"1695506473967"} 2023-09-23 22:01:13,968 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506473967"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506473967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506473967"}]},"ts":"1695506473967"} 2023-09-23 22:01:13,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 0733090a050b89131c92c16d7b27cb43, server=jenkins-hbase20.apache.org,45419,1695506434840}] 2023-09-23 22:01:13,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure ba8d0f43c4a1b20ffe193b0c28549896, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:01:14,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 22:01:14,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:14,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0733090a050b89131c92c16d7b27cb43, NAME => 'testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 22:01:14,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. service=AccessControlService 2023-09-23 22:01:14,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:14,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:01:14,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ba8d0f43c4a1b20ffe193b0c28549896, NAME => 'testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 22:01:14,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:14,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:14,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. service=AccessControlService 2023-09-23 22:01:14,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:14,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:14,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:01:14,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:14,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:14,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:14,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:14,138 INFO [StoreOpener-ba8d0f43c4a1b20ffe193b0c28549896-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:14,138 INFO [StoreOpener-0733090a050b89131c92c16d7b27cb43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:14,139 DEBUG [StoreOpener-ba8d0f43c4a1b20ffe193b0c28549896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/cf 2023-09-23 22:01:14,139 DEBUG [StoreOpener-ba8d0f43c4a1b20ffe193b0c28549896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/cf 2023-09-23 22:01:14,139 DEBUG [StoreOpener-0733090a050b89131c92c16d7b27cb43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/cf 2023-09-23 22:01:14,140 DEBUG [StoreOpener-0733090a050b89131c92c16d7b27cb43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/cf 2023-09-23 22:01:14,140 INFO [StoreOpener-ba8d0f43c4a1b20ffe193b0c28549896-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba8d0f43c4a1b20ffe193b0c28549896 columnFamilyName cf 2023-09-23 22:01:14,140 INFO [StoreOpener-0733090a050b89131c92c16d7b27cb43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0733090a050b89131c92c16d7b27cb43 columnFamilyName cf 2023-09-23 22:01:14,141 INFO [StoreOpener-0733090a050b89131c92c16d7b27cb43-1] regionserver.HStore(310): Store=0733090a050b89131c92c16d7b27cb43/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:01:14,141 INFO [StoreOpener-ba8d0f43c4a1b20ffe193b0c28549896-1] regionserver.HStore(310): Store=ba8d0f43c4a1b20ffe193b0c28549896/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:01:14,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:14,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:14,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:14,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:14,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:14,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:14,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:01:14,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:01:14,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ba8d0f43c4a1b20ffe193b0c28549896; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61684457, jitterRate=-0.08082996308803558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:01:14,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0733090a050b89131c92c16d7b27cb43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67385144, jitterRate=0.0041168928146362305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:01:14,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ba8d0f43c4a1b20ffe193b0c28549896: 2023-09-23 22:01:14,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0733090a050b89131c92c16d7b27cb43: 2023-09-23 22:01:14,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896., pid=46, masterSystemTime=1695506474126 2023-09-23 22:01:14,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43., pid=45, masterSystemTime=1695506474126 2023-09-23 22:01:14,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:14,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:14,151 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0733090a050b89131c92c16d7b27cb43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:14,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:14,151 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506474151"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506474151"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506474151"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506474151"}]},"ts":"1695506474151"} 2023-09-23 22:01:14,151 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ba8d0f43c4a1b20ffe193b0c28549896, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,152 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506474151"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506474151"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506474151"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506474151"}]},"ts":"1695506474151"} 2023-09-23 22:01:14,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-23 22:01:14,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 0733090a050b89131c92c16d7b27cb43, server=jenkins-hbase20.apache.org,45419,1695506434840 in 180 msec 2023-09-23 22:01:14,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-23 22:01:14,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure ba8d0f43c4a1b20ffe193b0c28549896, server=jenkins-hbase20.apache.org,38977,1695506434881 in 179 msec 2023-09-23 22:01:14,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0733090a050b89131c92c16d7b27cb43, ASSIGN in 347 msec 2023-09-23 22:01:14,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-23 22:01:14,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba8d0f43c4a1b20ffe193b0c28549896, ASSIGN in 348 msec 2023-09-23 22:01:14,158 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 22:01:14,158 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506474158"}]},"ts":"1695506474158"} 2023-09-23 22:01:14,160 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-23 22:01:14,162 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 22:01:14,162 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-23 22:01:14,164 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 22:01:14,165 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:14,165 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:14,165 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:14,165 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:14,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:14,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:14,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:14,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:14,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 404 msec 2023-09-23 22:01:14,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 22:01:14,374 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-23 22:01:14,382 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-23 22:01:14,382 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:14,388 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:01:14,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 22:01:14,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506474404 (current time:1695506474404). 2023-09-23 22:01:14,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:01:14,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x51e47090 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:14,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c6d4408, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:14,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:14,415 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:14,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51e47090 to 127.0.0.1:58910 2023-09-23 22:01:14,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:14,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x302c9188 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:14,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@423e07ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:14,431 DEBUG [hconnection-0x54e546a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:14,434 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:14,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:14,441 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:14,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x302c9188 to 127.0.0.1:58910 2023-09-23 22:01:14,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:14,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 22:01:14,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:01:14,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 22:01:14,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 22:01:14,448 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 22:01:14,449 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695507074448 2023-09-23 22:01:14,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 22:01:14,449 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-23 22:01:14,450 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:01:14,450 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:01:14,454 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 22:01:14,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 22:01:14,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-09-23 22:01:14,457 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 22:01:14,457 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695507074457 2023-09-23 22:01:14,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,467 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-23 22:01:14,467 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:14,469 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-23 22:01:14,469 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-23 22:01:14,469 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,469 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,470 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,470 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,470 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,470 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,470 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,470 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,471 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,471 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 22:01:14,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,472 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 22:01:14,472 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 22:01:14,472 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 22:01:14,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,472 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 22:01:14,472 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:14,472 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 22:01:14,473 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 22:01:14,473 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 22:01:14,472 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 22:01:14,473 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 22:01:14,473 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:14,473 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:14,474 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 22:01:14,477 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 22:01:14,477 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 22:01:14,477 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 22:01:14,477 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 22:01:14,477 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 22:01:14,478 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,478 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,478 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,478 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,478 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,478 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:14,479 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,479 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,479 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:14,479 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,479 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:14,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-23 22:01:14,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bfbe05c[Count = 1] remaining members to acquire global barrier 2023-09-23 22:01:14,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-23 22:01:14,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bfbe05c[Count = 0] remaining members to acquire global barrier 2023-09-23 22:01:14,484 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-23 22:01:14,484 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,497 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,497 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,497 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,498 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 22:01:14,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,498 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,498 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:14,498 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 22:01:14,498 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. started... 2023-09-23 22:01:14,498 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:14,498 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:14,498 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,499 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:01:14,499 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba8d0f43c4a1b20ffe193b0c28549896: 2023-09-23 22:01:14,498 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 22:01:14,498 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 22:01:14,499 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:01:14,499 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,499 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:14,499 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:14,499 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:14,499 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:14,499 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. started... 2023-09-23 22:01:14,500 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:01:14,501 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0733090a050b89131c92c16d7b27cb43: 2023-09-23 22:01:14,502 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,502 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:14,502 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:01:14,505 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 22:01:14,505 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:14,505 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 22:01:14,516 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. completed. 2023-09-23 22:01:14,516 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:01:14,516 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. completed. 2023-09-23 22:01:14,516 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 22:01:14,516 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:01:14,518 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 22:01:14,518 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,518 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:14,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,518 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 22:01:14,520 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 22:01:14,520 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:14,520 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 22:01:14,520 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,45419,1695506434840': 2023-09-23 22:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-23 22:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:01:14,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-23 22:01:14,528 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-23 22:01:14,528 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:01:14,528 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:01:14,528 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,528 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:01:14,529 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,529 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,530 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,530 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,533 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,533 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,533 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,546 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,546 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,546 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,546 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,546 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,547 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,546 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,546 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,547 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:14,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,547 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,547 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,549 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-23 22:01:14,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,549 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,550 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:01:14,550 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,550 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,550 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,550 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,550 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:14,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 22:01:14,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 22:01:14,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:01:14,552 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:01:14,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,580 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-23 22:01:14,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,581 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:14,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695506474449Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695506474562 (+113 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695506474562Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695506474562Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695506474566 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695506474574 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695506474580 (+6 ms) 2023-09-23 22:01:14,583 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 22:01:14,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 133 msec 2023-09-23 22:01:14,752 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:14,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 22:01:14,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:01:14,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38977] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:01:14,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45419] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:01:14,769 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-23 22:01:14,769 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:14,769 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:01:14,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 22:01:14,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506474780 (current time:1695506474780). 2023-09-23 22:01:14,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:01:14,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x36c3afbb to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:14,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@755f0758, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:14,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:14,797 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:14,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36c3afbb to 127.0.0.1:58910 2023-09-23 22:01:14,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:14,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x7e30278a to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:14,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55a5e180, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:14,808 DEBUG [hconnection-0x58cd49ab-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:14,812 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:14,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:14,820 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:14,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e30278a to 127.0.0.1:58910 2023-09-23 22:01:14,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:14,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 22:01:14,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:01:14,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 22:01:14,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 22:01:14,826 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 22:01:14,827 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695507074827 2023-09-23 22:01:14,827 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-23 22:01:14,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 22:01:14,829 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:01:14,829 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:01:14,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 22:01:14,830 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 22:01:14,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-23 22:01:14,832 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 22:01:14,833 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695507074833 2023-09-23 22:01:14,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-23 22:01:14,844 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-23 22:01:14,844 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:14,845 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-23 22:01:14,845 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-23 22:01:14,846 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,846 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,847 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,847 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,847 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,847 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,847 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,847 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,848 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,848 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 22:01:14,848 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 22:01:14,848 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 22:01:14,849 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 22:01:14,850 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 22:01:14,850 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 22:01:14,848 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:14,850 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 22:01:14,850 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 22:01:14,851 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:14,850 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 22:01:14,851 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 22:01:14,851 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 22:01:14,851 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 22:01:14,851 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 22:01:14,851 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 22:01:14,854 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,854 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,854 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,854 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,855 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:14,854 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,855 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,855 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,855 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,855 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,855 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 22:01:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-23 22:01:14,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36d815b[Count = 1] remaining members to acquire global barrier 2023-09-23 22:01:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 22:01:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-23 22:01:14,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36d815b[Count = 0] remaining members to acquire global barrier 2023-09-23 22:01:14,860 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-23 22:01:14,860 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,862 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,862 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,862 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,863 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 22:01:14,863 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 22:01:14,863 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 22:01:14,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,863 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,863 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:14,863 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 22:01:14,863 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. started... 2023-09-23 22:01:14,863 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:14,863 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:01:14,863 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:14,863 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:14,863 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,864 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:01:14,863 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:14,864 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0733090a050b89131c92c16d7b27cb43 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-23 22:01:14,863 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:14,864 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. started... 2023-09-23 22:01:14,864 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ba8d0f43c4a1b20ffe193b0c28549896 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-23 22:01:14,865 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 22:01:14,865 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:14,865 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 22:01:14,903 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230923145c8e1807504c049620ee2035baea34 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923145c8e1807504c049620ee2035baea34 2023-09-23 22:01:14,915 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309232ea94723214e4711a6eb8bb5a72239f6 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309232ea94723214e4711a6eb8bb5a72239f6 2023-09-23 22:01:14,917 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/.tmp/cf/a17b35a632424f7290e44d2f5f745ff2 2023-09-23 22:01:14,922 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/.tmp/cf/93db6c1709414a4d99fe1c5480b9f168 2023-09-23 22:01:14,923 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/.tmp/cf/a17b35a632424f7290e44d2f5f745ff2 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/cf/a17b35a632424f7290e44d2f5f745ff2 2023-09-23 22:01:14,928 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/cf/a17b35a632424f7290e44d2f5f745ff2, entries=2, sequenceid=6, filesize=5.2 K 2023-09-23 22:01:14,928 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/.tmp/cf/93db6c1709414a4d99fe1c5480b9f168 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/cf/93db6c1709414a4d99fe1c5480b9f168 2023-09-23 22:01:14,929 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for ba8d0f43c4a1b20ffe193b0c28549896 in 65ms, sequenceid=6, compaction requested=false 2023-09-23 22:01:14,929 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-23 22:01:14,929 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:14,929 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba8d0f43c4a1b20ffe193b0c28549896: 2023-09-23 22:01:14,929 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 22:01:14,929 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:14,930 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/cf/a17b35a632424f7290e44d2f5f745ff2] hfiles 2023-09-23 22:01:14,930 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/cf/a17b35a632424f7290e44d2f5f745ff2 for snapshot=snaptb0-testConsecutiveExports 2023-09-23 22:01:14,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 22:01:14,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:01:14,930 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:01:14,934 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/cf/93db6c1709414a4d99fe1c5480b9f168, entries=48, sequenceid=6, filesize=12.9 K 2023-09-23 22:01:14,935 INFO [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0733090a050b89131c92c16d7b27cb43 in 72ms, sequenceid=6, compaction requested=false 2023-09-23 22:01:14,940 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0733090a050b89131c92c16d7b27cb43: 2023-09-23 22:01:14,940 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 22:01:14,940 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:14,940 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/cf/93db6c1709414a4d99fe1c5480b9f168] hfiles 2023-09-23 22:01:14,940 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/cf/93db6c1709414a4d99fe1c5480b9f168 for snapshot=snaptb0-testConsecutiveExports 2023-09-23 22:01:14,943 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. completed. 2023-09-23 22:01:14,943 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:14,944 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:14,944 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:14,944 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,944 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 22:01:14,944 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:01:14,945 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,945 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 22:01:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,945 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:14,945 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 22:01:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 22:01:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 22:01:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:01:14,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-23 22:01:14,951 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. completed. 2023-09-23 22:01:14,951 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:14,951 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:14,951 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:14,951 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,951 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 22:01:14,951 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:01:14,954 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 22:01:14,954 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:14,954 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 22:01:14,954 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 22:01:14,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 22:01:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,45419,1695506434840': 2023-09-23 22:01:14,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-23 22:01:14,959 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-23 22:01:14,959 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:01:14,959 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:01:14,959 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-23 22:01:14,959 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:01:14,963 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,963 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,963 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:14,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,963 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,963 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,963 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:14,963 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,964 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 22:01:14,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:14,964 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 22:01:14,965 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 22:01:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,966 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,966 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,967 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,972 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,972 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,972 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:14,972 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,972 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,973 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,973 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-23 22:01:14,973 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,973 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:14,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,972 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:14,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:14,973 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,973 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-23 22:01:14,975 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,975 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,975 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:14,975 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,975 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:14,975 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:14,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 22:01:14,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:14,975 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:14,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:01:14,975 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 22:01:14,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309232ea94723214e4711a6eb8bb5a72239f6, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923145c8e1807504c049620ee2035baea34] mob files 2023-09-23 22:01:14,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309232ea94723214e4711a6eb8bb5a72239f6 2023-09-23 22:01:14,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923145c8e1807504c049620ee2035baea34 2023-09-23 22:01:14,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-23 22:01:14,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 22:01:15,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 22:01:15,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-23 22:01:15,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 22:01:15,015 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 22:01:15,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695506474827Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695506474991 (+164 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695506474991Loading Region manifests for snaptb0-testConsecutiveExports at 1695506474991Writing data manifest for snaptb0-testConsecutiveExports at 1695506474996 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695506475006 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695506475015 (+9 ms) 2023-09-23 22:01:15,017 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 22:01:15,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 189 msec 2023-09-23 22:01:15,131 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:15,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 22:01:15,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:01:15,133 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133 2023-09-23 22:01:15,133 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133, srcFsUri=hdfs://localhost:45753, srcDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:01:15,156 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:01:15,156 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3bbf7691, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 22:01:15,156 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523, snapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-23 22:01:15,164 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 22:01:15,174 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,174 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,174 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,175 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,882 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-1307030984676783235.jar 2023-09-23 22:01:15,883 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,883 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,938 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-5854851867274448111.jar 2023-09-23 22:01:15,938 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,939 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,939 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,939 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,940 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,940 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:15,940 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 22:01:15,940 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 22:01:15,941 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 22:01:15,941 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 22:01:15,941 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 22:01:15,942 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 22:01:15,942 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 22:01:15,942 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 22:01:15,943 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 22:01:15,943 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 22:01:15,943 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:15,944 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:15,944 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:15,944 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:15,945 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:15,945 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:15,945 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:16,304 WARN [Listener at jenkins-hbase20.apache.org/38553] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 22:01:16,306 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-23 22:01:16,308 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-23 22:01:17,122 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:01:17,122 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:01:17,124 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0002_000001 (auth:SIMPLE) 2023-09-23 22:01:17,173 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0003_000001 (auth:SIMPLE) 2023-09-23 22:01:18,631 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 22:01:20,575 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0003_000001 (auth:SIMPLE) 2023-09-23 22:01:22,773 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0003_000001 (auth:SIMPLE) 2023-09-23 22:01:25,227 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0003_000001 (auth:SIMPLE) 2023-09-23 22:01:25,237 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695506440948_0003_01_000002 is : 143 2023-09-23 22:01:26,489 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 22:01:26,489 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 22:01:26,492 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-23 22:01:26,492 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 22:01:26,493 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 22:01:26,494 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 22:01:26,496 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 22:01:26,496 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 22:01:26,496 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@b962e0b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 22:01:26,497 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 22:01:26,497 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 22:01:26,498 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133, srcFsUri=hdfs://localhost:45753, srcDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:01:26,516 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:01:26,516 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@258fb298, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 22:01:26,516 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523, snapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-23 22:01:26,529 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 22:01:26,540 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:26,541 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:26,541 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:26,541 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:27,249 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-406699335200165602.jar 2023-09-23 22:01:27,250 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:27,250 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:27,303 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-450639458791220583.jar 2023-09-23 22:01:27,303 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:27,303 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:27,304 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:27,304 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:27,304 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:27,305 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:27,305 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 22:01:27,305 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 22:01:27,306 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 22:01:27,306 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 22:01:27,306 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 22:01:27,307 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 22:01:27,307 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 22:01:27,307 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 22:01:27,307 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 22:01:27,308 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 22:01:27,308 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:27,308 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:27,309 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:27,309 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:27,309 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:27,310 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:27,310 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:27,649 WARN [Listener at jenkins-hbase20.apache.org/38553] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 22:01:27,652 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-23 22:01:27,654 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-23 22:01:31,419 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:01:31,419 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:01:31,422 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0003_000001 (auth:SIMPLE) 2023-09-23 22:01:32,264 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0004_000001 (auth:SIMPLE) 2023-09-23 22:01:35,513 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0004_000001 (auth:SIMPLE) 2023-09-23 22:01:37,716 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0004_000001 (auth:SIMPLE) 2023-09-23 22:01:39,599 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0004_000001 (auth:SIMPLE) 2023-09-23 22:01:39,610 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695506440948_0004_01_000002 is : 143 2023-09-23 22:01:40,850 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 22:01:40,851 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 22:01:40,853 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-23 22:01:40,853 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 22:01:40,853 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 22:01:40,853 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 22:01:40,854 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 22:01:40,854 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 22:01:40,854 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@b962e0b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 22:01:40,854 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 22:01:40,854 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/local-export-1695506475133/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 22:01:40,865 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-23 22:01:40,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-09-23 22:01:40,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-23 22:01:40,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 22:01:40,869 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506500869"}]},"ts":"1695506500869"} 2023-09-23 22:01:40,871 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-23 22:01:40,872 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-23 22:01:40,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba8d0f43c4a1b20ffe193b0c28549896, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0733090a050b89131c92c16d7b27cb43, UNASSIGN}] 2023-09-23 22:01:40,875 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0733090a050b89131c92c16d7b27cb43, UNASSIGN 2023-09-23 22:01:40,875 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba8d0f43c4a1b20ffe193b0c28549896, UNASSIGN 2023-09-23 22:01:40,876 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0733090a050b89131c92c16d7b27cb43, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:40,876 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ba8d0f43c4a1b20ffe193b0c28549896, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:40,876 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506500876"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506500876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506500876"}]},"ts":"1695506500876"} 2023-09-23 22:01:40,876 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506500876"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506500876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506500876"}]},"ts":"1695506500876"} 2023-09-23 22:01:40,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 0733090a050b89131c92c16d7b27cb43, server=jenkins-hbase20.apache.org,45419,1695506434840}] 2023-09-23 22:01:40,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure ba8d0f43c4a1b20ffe193b0c28549896, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:01:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 22:01:41,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0733090a050b89131c92c16d7b27cb43, disabling compactions & flushes 2023-09-23 22:01:41,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. after waiting 0 ms 2023-09-23 22:01:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:41,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:41,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ba8d0f43c4a1b20ffe193b0c28549896, disabling compactions & flushes 2023-09-23 22:01:41,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:41,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:41,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. after waiting 0 ms 2023-09-23 22:01:41,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:41,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:01:41,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:01:41,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:01:41,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:01:41,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896. 2023-09-23 22:01:41,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43. 2023-09-23 22:01:41,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ba8d0f43c4a1b20ffe193b0c28549896: 2023-09-23 22:01:41,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0733090a050b89131c92c16d7b27cb43: 2023-09-23 22:01:41,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:41,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ba8d0f43c4a1b20ffe193b0c28549896, regionState=CLOSED 2023-09-23 22:01:41,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:41,052 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506501052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506501052"}]},"ts":"1695506501052"} 2023-09-23 22:01:41,052 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0733090a050b89131c92c16d7b27cb43, regionState=CLOSED 2023-09-23 22:01:41,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695506501052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506501052"}]},"ts":"1695506501052"} 2023-09-23 22:01:41,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-23 22:01:41,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure ba8d0f43c4a1b20ffe193b0c28549896, server=jenkins-hbase20.apache.org,38977,1695506434881 in 174 msec 2023-09-23 22:01:41,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-23 22:01:41,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 0733090a050b89131c92c16d7b27cb43, server=jenkins-hbase20.apache.org,45419,1695506434840 in 176 msec 2023-09-23 22:01:41,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba8d0f43c4a1b20ffe193b0c28549896, UNASSIGN in 182 msec 2023-09-23 22:01:41,058 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-23 22:01:41,058 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0733090a050b89131c92c16d7b27cb43, UNASSIGN in 183 msec 2023-09-23 22:01:41,059 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506501059"}]},"ts":"1695506501059"} 2023-09-23 22:01:41,061 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-23 22:01:41,062 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-23 22:01:41,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 196 msec 2023-09-23 22:01:41,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 22:01:41,173 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-23 22:01:41,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-09-23 22:01:41,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 22:01:41,179 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 22:01:41,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-23 22:01:41,181 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 22:01:41,182 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-23 22:01:41,184 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 22:01:41,184 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 22:01:41,184 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 22:01:41,184 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 22:01:41,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 22:01:41,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 22:01:41,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 22:01:41,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 22:01:41,186 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 22:01:41,186 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 22:01:41,186 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 22:01:41,186 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:41,186 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:41,186 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 22:01:41,186 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:41,186 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:41,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-23 22:01:41,187 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:41,187 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:41,189 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/recovered.edits] 2023-09-23 22:01:41,189 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/recovered.edits] 2023-09-23 22:01:41,194 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/cf/93db6c1709414a4d99fe1c5480b9f168 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/cf/93db6c1709414a4d99fe1c5480b9f168 2023-09-23 22:01:41,194 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/cf/a17b35a632424f7290e44d2f5f745ff2 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/cf/a17b35a632424f7290e44d2f5f745ff2 2023-09-23 22:01:41,197 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43/recovered.edits/9.seqid 2023-09-23 22:01:41,197 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896/recovered.edits/9.seqid 2023-09-23 22:01:41,197 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/0733090a050b89131c92c16d7b27cb43 2023-09-23 22:01:41,197 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testConsecutiveExports/ba8d0f43c4a1b20ffe193b0c28549896 2023-09-23 22:01:41,197 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-23 22:01:41,198 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-23 22:01:41,198 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-23 22:01:41,201 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309232ea94723214e4711a6eb8bb5a72239f6 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309232ea94723214e4711a6eb8bb5a72239f6 2023-09-23 22:01:41,202 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923145c8e1807504c049620ee2035baea34 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923145c8e1807504c049620ee2035baea34 2023-09-23 22:01:41,203 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-23 22:01:41,205 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 22:01:41,207 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-23 22:01:41,209 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-23 22:01:41,210 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 22:01:41,211 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-23 22:01:41,211 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506501211"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:41,211 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506501211"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:41,213 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 22:01:41,213 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ba8d0f43c4a1b20ffe193b0c28549896, NAME => 'testtb-testConsecutiveExports,,1695506473761.ba8d0f43c4a1b20ffe193b0c28549896.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0733090a050b89131c92c16d7b27cb43, NAME => 'testtb-testConsecutiveExports,1,1695506473761.0733090a050b89131c92c16d7b27cb43.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 22:01:41,213 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-23 22:01:41,213 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695506501213"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:41,214 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-23 22:01:41,216 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 22:01:41,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-09-23 22:01:41,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-23 22:01:41,289 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-23 22:01:41,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-23 22:01:41,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-23 22:01:41,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-09-23 22:01:41,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-23 22:01:41,330 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763 (was 765), OpenFileDescriptor=921 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 233), ProcessCount=166 (was 166), AvailableMemoryMB=7303 (was 7402) 2023-09-23 22:01:41,330 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-23 22:01:41,348 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=166, AvailableMemoryMB=7302 2023-09-23 22:01:41,348 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-23 22:01:41,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 22:01:41,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:41,354 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 22:01:41,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-23 22:01:41,355 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 22:01:41,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 22:01:41,357 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d 2023-09-23 22:01:41,357 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:41,358 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d empty. 2023-09-23 22:01:41,358 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874 empty. 2023-09-23 22:01:41,358 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d 2023-09-23 22:01:41,358 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:41,358 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-23 22:01:41,374 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-23 22:01:41,375 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 869151733feb9b398089e9d109423d1d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:01:41,375 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 289a73d6398cc8c8831e1cfcd2984874, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:01:41,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:41,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:41,396 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 289a73d6398cc8c8831e1cfcd2984874, disabling compactions & flushes 2023-09-23 22:01:41,397 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 869151733feb9b398089e9d109423d1d, disabling compactions & flushes 2023-09-23 22:01:41,397 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:41,397 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:41,397 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:41,397 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:41,397 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. after waiting 0 ms 2023-09-23 22:01:41,397 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. after waiting 0 ms 2023-09-23 22:01:41,397 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:41,397 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:41,397 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:41,397 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:41,397 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 289a73d6398cc8c8831e1cfcd2984874: 2023-09-23 22:01:41,397 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 869151733feb9b398089e9d109423d1d: 2023-09-23 22:01:41,400 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 22:01:41,401 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506501401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506501401"}]},"ts":"1695506501401"} 2023-09-23 22:01:41,401 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506501401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506501401"}]},"ts":"1695506501401"} 2023-09-23 22:01:41,406 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 22:01:41,407 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 22:01:41,407 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506501407"}]},"ts":"1695506501407"} 2023-09-23 22:01:41,409 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-23 22:01:41,411 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:01:41,412 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:01:41,412 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:01:41,412 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:01:41,412 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:01:41,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=869151733feb9b398089e9d109423d1d, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=289a73d6398cc8c8831e1cfcd2984874, ASSIGN}] 2023-09-23 22:01:41,414 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=289a73d6398cc8c8831e1cfcd2984874, ASSIGN 2023-09-23 22:01:41,414 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=869151733feb9b398089e9d109423d1d, ASSIGN 2023-09-23 22:01:41,415 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=869151733feb9b398089e9d109423d1d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44169,1695506434796; forceNewPlan=false, retain=false 2023-09-23 22:01:41,415 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=289a73d6398cc8c8831e1cfcd2984874, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38977,1695506434881; forceNewPlan=false, retain=false 2023-09-23 22:01:41,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 22:01:41,565 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 22:01:41,570 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=869151733feb9b398089e9d109423d1d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:41,570 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=289a73d6398cc8c8831e1cfcd2984874, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:41,571 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506501570"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506501570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506501570"}]},"ts":"1695506501570"} 2023-09-23 22:01:41,571 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506501570"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506501570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506501570"}]},"ts":"1695506501570"} 2023-09-23 22:01:41,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 869151733feb9b398089e9d109423d1d, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:01:41,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 289a73d6398cc8c8831e1cfcd2984874, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:01:41,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 22:01:41,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:41,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:41,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 869151733feb9b398089e9d109423d1d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 22:01:41,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 289a73d6398cc8c8831e1cfcd2984874, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 22:01:41,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. service=AccessControlService 2023-09-23 22:01:41,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. service=AccessControlService 2023-09-23 22:01:41,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:01:41,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:01:41,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 869151733feb9b398089e9d109423d1d 2023-09-23 22:01:41,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:41,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:41,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 869151733feb9b398089e9d109423d1d 2023-09-23 22:01:41,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:41,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 869151733feb9b398089e9d109423d1d 2023-09-23 22:01:41,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:41,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:41,741 INFO [StoreOpener-289a73d6398cc8c8831e1cfcd2984874-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:41,741 INFO [StoreOpener-869151733feb9b398089e9d109423d1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 869151733feb9b398089e9d109423d1d 2023-09-23 22:01:41,743 DEBUG [StoreOpener-289a73d6398cc8c8831e1cfcd2984874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/cf 2023-09-23 22:01:41,744 DEBUG [StoreOpener-289a73d6398cc8c8831e1cfcd2984874-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/cf 2023-09-23 22:01:41,744 DEBUG [StoreOpener-869151733feb9b398089e9d109423d1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/cf 2023-09-23 22:01:41,744 DEBUG [StoreOpener-869151733feb9b398089e9d109423d1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/cf 2023-09-23 22:01:41,745 INFO [StoreOpener-289a73d6398cc8c8831e1cfcd2984874-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 289a73d6398cc8c8831e1cfcd2984874 columnFamilyName cf 2023-09-23 22:01:41,745 INFO [StoreOpener-869151733feb9b398089e9d109423d1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 869151733feb9b398089e9d109423d1d columnFamilyName cf 2023-09-23 22:01:41,746 INFO [StoreOpener-289a73d6398cc8c8831e1cfcd2984874-1] regionserver.HStore(310): Store=289a73d6398cc8c8831e1cfcd2984874/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:01:41,746 INFO [StoreOpener-869151733feb9b398089e9d109423d1d-1] regionserver.HStore(310): Store=869151733feb9b398089e9d109423d1d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:01:41,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d 2023-09-23 22:01:41,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:41,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d 2023-09-23 22:01:41,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:41,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:41,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 869151733feb9b398089e9d109423d1d 2023-09-23 22:01:41,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:01:41,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:01:41,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 289a73d6398cc8c8831e1cfcd2984874; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74413061, jitterRate=0.10884101688861847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:01:41,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 869151733feb9b398089e9d109423d1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59340923, jitterRate=-0.11575134098529816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:01:41,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 289a73d6398cc8c8831e1cfcd2984874: 2023-09-23 22:01:41,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 869151733feb9b398089e9d109423d1d: 2023-09-23 22:01:41,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874., pid=61, masterSystemTime=1695506501728 2023-09-23 22:01:41,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d., pid=60, masterSystemTime=1695506501728 2023-09-23 22:01:41,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:41,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:41,758 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=289a73d6398cc8c8831e1cfcd2984874, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:41,758 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506501758"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506501758"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506501758"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506501758"}]},"ts":"1695506501758"} 2023-09-23 22:01:41,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:41,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:41,759 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=869151733feb9b398089e9d109423d1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:41,759 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506501759"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506501759"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506501759"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506501759"}]},"ts":"1695506501759"} 2023-09-23 22:01:41,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-23 22:01:41,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 289a73d6398cc8c8831e1cfcd2984874, server=jenkins-hbase20.apache.org,38977,1695506434881 in 183 msec 2023-09-23 22:01:41,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-23 22:01:41,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 869151733feb9b398089e9d109423d1d, server=jenkins-hbase20.apache.org,44169,1695506434796 in 186 msec 2023-09-23 22:01:41,764 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=289a73d6398cc8c8831e1cfcd2984874, ASSIGN in 350 msec 2023-09-23 22:01:41,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-23 22:01:41,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=869151733feb9b398089e9d109423d1d, ASSIGN in 351 msec 2023-09-23 22:01:41,765 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 22:01:41,766 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506501765"}]},"ts":"1695506501765"} 2023-09-23 22:01:41,767 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-23 22:01:41,769 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 22:01:41,770 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-23 22:01:41,771 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 22:01:41,772 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:41,773 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:41,773 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:41,773 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:41,774 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:41,774 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:41,774 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:41,774 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:41,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 423 msec 2023-09-23 22:01:41,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 22:01:41,961 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-23 22:01:41,967 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:41,967 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:41,969 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:01:41,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 22:01:41,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506501981 (current time:1695506501981). 2023-09-23 22:01:41,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:01:41,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x3eefd130 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:41,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77f3ec46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:41,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:41,992 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:41,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3eefd130 to 127.0.0.1:58910 2023-09-23 22:01:41,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:41,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x6514c38c to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:41,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2532e84f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:42,001 DEBUG [hconnection-0x4d4bb173-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:42,002 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:42,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:42,009 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:42,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6514c38c to 127.0.0.1:58910 2023-09-23 22:01:42,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:42,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 22:01:42,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:01:42,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 22:01:42,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 22:01:42,015 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 22:01:42,015 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695507102015 2023-09-23 22:01:42,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 22:01:42,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,017 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:01:42,017 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:01:42,019 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 22:01:42,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 22:01:42,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-23 22:01:42,022 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 22:01:42,022 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695507102022 2023-09-23 22:01:42,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,034 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-23 22:01:42,034 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:42,035 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-23 22:01:42,035 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-23 22:01:42,036 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,036 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,036 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,036 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,036 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,036 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,037 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,037 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,037 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,037 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 22:01:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 22:01:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 22:01:42,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 22:01:42,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 22:01:42,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,038 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 22:01:42,038 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 22:01:42,038 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:42,038 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 22:01:42,040 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 22:01:42,040 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 22:01:42,038 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:42,040 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 22:01:42,040 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:42,040 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 22:01:42,041 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 22:01:42,041 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 22:01:42,041 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 22:01:42,041 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 22:01:42,041 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 22:01:42,042 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,042 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,042 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,042 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,042 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,042 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:42,042 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,042 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,042 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:42,042 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,042 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 22:01:42,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7183da21[Count = 1] remaining members to acquire global barrier 2023-09-23 22:01:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 22:01:42,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7183da21[Count = 0] remaining members to acquire global barrier 2023-09-23 22:01:42,045 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-23 22:01:42,045 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 22:01:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 22:01:42,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 22:01:42,046 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,046 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:01:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:01:42,046 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 22:01:42,046 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. started... 2023-09-23 22:01:42,047 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:42,047 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:42,047 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:42,047 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 869151733feb9b398089e9d109423d1d: 2023-09-23 22:01:42,047 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. started... 2023-09-23 22:01:42,048 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 289a73d6398cc8c8831e1cfcd2984874: 2023-09-23 22:01:42,048 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,048 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:42,048 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,048 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:01:42,048 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 22:01:42,048 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:42,048 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:42,048 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:01:42,048 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 22:01:42,057 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. completed. 2023-09-23 22:01:42,057 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. completed. 2023-09-23 22:01:42,057 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:42,057 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:01:42,057 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:01:42,062 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 22:01:42,062 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 22:01:42,062 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:42,062 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 22:01:42,062 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:42,064 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 22:01:42,062 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,064 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:01:42,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-23 22:01:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:01:42,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-23 22:01:42,074 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-23 22:01:42,074 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:01:42,074 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:01:42,074 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,074 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:01:42,075 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,075 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,075 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,075 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,075 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,076 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,076 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,076 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,078 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,078 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,081 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,081 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,081 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,095 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,096 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,096 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,095 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,096 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,096 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:42,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,096 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,096 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,096 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,097 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,097 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:01:42,098 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,098 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,098 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,098 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,098 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,098 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,098 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 22:01:42,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,119 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:42,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 22:01:42,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:01:42,120 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:01:42,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-23 22:01:42,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,126 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695506502016Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695506502107 (+91 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695506502107Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695506502108 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695506502110 (+2 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695506502119 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695506502125 (+6 ms) 2023-09-23 22:01:42,128 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 22:01:42,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 111 msec 2023-09-23 22:01:42,320 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:42,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 22:01:42,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:01:42,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44169] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:01:42,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38977] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:01:42,335 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,335 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:42,335 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:01:42,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 22:01:42,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506502347 (current time:1695506502347). 2023-09-23 22:01:42,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:01:42,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x2e2b46d6 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:42,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@765fd472, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:42,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:42,356 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:42,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e2b46d6 to 127.0.0.1:58910 2023-09-23 22:01:42,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:42,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x2fafe8d6 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:42,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ae36622, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:42,364 DEBUG [hconnection-0x1c3da86e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:42,367 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:42,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:42,374 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:42,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fafe8d6 to 127.0.0.1:58910 2023-09-23 22:01:42,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:42,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 22:01:42,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:01:42,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 22:01:42,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 22:01:42,380 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 22:01:42,380 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695507102380 2023-09-23 22:01:42,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 22:01:42,380 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,381 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:01:42,381 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:01:42,383 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 22:01:42,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 22:01:42,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-23 22:01:42,385 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 22:01:42,386 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695507102386 2023-09-23 22:01:42,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,394 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-23 22:01:42,394 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:42,395 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-23 22:01:42,395 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-23 22:01:42,396 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,396 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,396 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,396 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,396 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,397 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,397 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,397 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,397 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,397 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,398 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 22:01:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 22:01:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 22:01:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,398 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 22:01:42,398 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 22:01:42,398 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 22:01:42,398 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:42,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,398 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 22:01:42,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,399 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 22:01:42,399 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 22:01:42,399 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:42,399 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 22:01:42,400 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 22:01:42,399 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:42,400 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 22:01:42,400 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 22:01:42,400 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 22:01:42,401 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 22:01:42,401 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 22:01:42,400 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 22:01:42,403 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,403 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,404 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,404 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,404 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,404 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,404 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:42,404 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,404 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,405 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,405 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 22:01:42,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cd20596[Count = 1] remaining members to acquire global barrier 2023-09-23 22:01:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 22:01:42,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cd20596[Count = 0] remaining members to acquire global barrier 2023-09-23 22:01:42,409 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-23 22:01:42,409 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 22:01:42,412 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 22:01:42,412 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:01:42,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,412 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 22:01:42,413 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 22:01:42,413 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,413 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:01:42,413 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:42,413 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:42,413 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:42,413 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:42,413 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:42,413 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. started... 2023-09-23 22:01:42,413 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:42,413 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. started... 2023-09-23 22:01:42,413 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 22:01:42,413 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 869151733feb9b398089e9d109423d1d 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-23 22:01:42,413 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:42,413 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 289a73d6398cc8c8831e1cfcd2984874 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-23 22:01:42,413 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 22:01:42,434 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092397a0ab7c4d4e44b382344d40480ab4e2 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092397a0ab7c4d4e44b382344d40480ab4e2 2023-09-23 22:01:42,434 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309236c06a89769674aa4b7e4806027ae8d75 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309236c06a89769674aa4b7e4806027ae8d75 2023-09-23 22:01:42,442 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/.tmp/cf/3407d7fcf8fc48bb93b2c126296045cb 2023-09-23 22:01:42,442 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/.tmp/cf/1a42e5c6fa7040d4832476c2e32cf340 2023-09-23 22:01:42,447 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/.tmp/cf/3407d7fcf8fc48bb93b2c126296045cb as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/cf/3407d7fcf8fc48bb93b2c126296045cb 2023-09-23 22:01:42,447 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/.tmp/cf/1a42e5c6fa7040d4832476c2e32cf340 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/cf/1a42e5c6fa7040d4832476c2e32cf340 2023-09-23 22:01:42,452 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/cf/1a42e5c6fa7040d4832476c2e32cf340, entries=45, sequenceid=6, filesize=13.2 K 2023-09-23 22:01:42,452 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/cf/3407d7fcf8fc48bb93b2c126296045cb, entries=5, sequenceid=6, filesize=5.8 K 2023-09-23 22:01:42,453 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 289a73d6398cc8c8831e1cfcd2984874 in 40ms, sequenceid=6, compaction requested=false 2023-09-23 22:01:42,453 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-23 22:01:42,454 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 289a73d6398cc8c8831e1cfcd2984874: 2023-09-23 22:01:42,454 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,454 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:42,454 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/cf/1a42e5c6fa7040d4832476c2e32cf340] hfiles 2023-09-23 22:01:42,454 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/cf/1a42e5c6fa7040d4832476c2e32cf340 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,454 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 869151733feb9b398089e9d109423d1d in 41ms, sequenceid=6, compaction requested=false 2023-09-23 22:01:42,456 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 869151733feb9b398089e9d109423d1d: 2023-09-23 22:01:42,456 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,456 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:42,456 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/cf/3407d7fcf8fc48bb93b2c126296045cb] hfiles 2023-09-23 22:01:42,456 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/cf/3407d7fcf8fc48bb93b2c126296045cb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,467 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. completed. 2023-09-23 22:01:42,467 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:42,467 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. completed. 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:42,467 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:01:42,467 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:01:42,468 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,468 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 22:01:42,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,468 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:42,469 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 22:01:42,469 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,469 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 22:01:42,470 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:42,470 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 22:01:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:01:42,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-23 22:01:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:01:42,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-23 22:01:42,480 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-23 22:01:42,480 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:01:42,480 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:01:42,480 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,480 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:01:42,481 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:42,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 22:01:42,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:01:42,482 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:01:42,488 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,488 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,488 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:42,488 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,488 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,488 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,489 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,488 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,489 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:42,490 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:42,493 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,493 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,494 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:42,498 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,498 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:42,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,498 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:42,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,498 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:42,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:01:42,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:42,500 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:42,501 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,501 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,501 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,501 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,501 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:42,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:42,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309236c06a89769674aa4b7e4806027ae8d75, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092397a0ab7c4d4e44b382344d40480ab4e2] mob files 2023-09-23 22:01:42,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309236c06a89769674aa4b7e4806027ae8d75 2023-09-23 22:01:42,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092397a0ab7c4d4e44b382344d40480ab4e2 2023-09-23 22:01:42,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-23 22:01:42,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,530 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:42,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695506502381Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695506502514 (+133 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695506502514Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695506502514Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695506502517 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695506502523 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695506502530 (+7 ms) 2023-09-23 22:01:42,532 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 22:01:42,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 151 msec 2023-09-23 22:01:42,683 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:42,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 22:01:42,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:01:42,718 DEBUG [Listener at jenkins-hbase20.apache.org/38553] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 22:01:42,722 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 22:01:42,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38977] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 22:01:42,724 DEBUG [Listener at jenkins-hbase20.apache.org/38553] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 22:01:42,726 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 22:01:42,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44169] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 22:01:42,727 DEBUG [Listener at jenkins-hbase20.apache.org/38553] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 22:01:42,731 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 22:01:42,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45419] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 22:01:42,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-23 22:01:42,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:42,736 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 22:01:42,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-23 22:01:42,737 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 22:01:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 22:01:42,739 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:42,739 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122 2023-09-23 22:01:42,740 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b empty. 2023-09-23 22:01:42,740 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122 empty. 2023-09-23 22:01:42,740 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:42,740 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122 2023-09-23 22:01:42,740 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-23 22:01:42,752 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-23 22:01:42,754 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4fb2369c23b67da245764b130beec122, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:01:42,754 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d0ea78c7f5e6040e90873a5c4ef44e3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d0ea78c7f5e6040e90873a5c4ef44e3b, disabling compactions & flushes 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 4fb2369c23b67da245764b130beec122, disabling compactions & flushes 2023-09-23 22:01:42,768 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:42,768 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. after waiting 0 ms 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. after waiting 0 ms 2023-09-23 22:01:42,768 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:42,768 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d0ea78c7f5e6040e90873a5c4ef44e3b: 2023-09-23 22:01:42,768 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:42,769 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 4fb2369c23b67da245764b130beec122: 2023-09-23 22:01:42,771 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 22:01:42,771 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506502771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506502771"}]},"ts":"1695506502771"} 2023-09-23 22:01:42,772 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506502771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506502771"}]},"ts":"1695506502771"} 2023-09-23 22:01:42,773 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 22:01:42,774 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 22:01:42,774 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506502774"}]},"ts":"1695506502774"} 2023-09-23 22:01:42,775 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-23 22:01:42,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:01:42,779 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:01:42,779 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:01:42,779 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:01:42,779 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:01:42,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0ea78c7f5e6040e90873a5c4ef44e3b, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4fb2369c23b67da245764b130beec122, ASSIGN}] 2023-09-23 22:01:42,782 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4fb2369c23b67da245764b130beec122, ASSIGN 2023-09-23 22:01:42,782 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0ea78c7f5e6040e90873a5c4ef44e3b, ASSIGN 2023-09-23 22:01:42,783 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0ea78c7f5e6040e90873a5c4ef44e3b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,45419,1695506434840; forceNewPlan=false, retain=false 2023-09-23 22:01:42,783 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4fb2369c23b67da245764b130beec122, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38977,1695506434881; forceNewPlan=false, retain=false 2023-09-23 22:01:42,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 22:01:42,933 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 22:01:42,938 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d0ea78c7f5e6040e90873a5c4ef44e3b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:42,938 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4fb2369c23b67da245764b130beec122, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:42,938 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506502938"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506502938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506502938"}]},"ts":"1695506502938"} 2023-09-23 22:01:42,938 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506502938"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506502938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506502938"}]},"ts":"1695506502938"} 2023-09-23 22:01:42,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure d0ea78c7f5e6040e90873a5c4ef44e3b, server=jenkins-hbase20.apache.org,45419,1695506434840}] 2023-09-23 22:01:42,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 4fb2369c23b67da245764b130beec122, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:01:43,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 22:01:43,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:43,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:43,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0ea78c7f5e6040e90873a5c4ef44e3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.', STARTKEY => '', ENDKEY => '2'} 2023-09-23 22:01:43,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4fb2369c23b67da245764b130beec122, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.', STARTKEY => '2', ENDKEY => ''} 2023-09-23 22:01:43,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. service=AccessControlService 2023-09-23 22:01:43,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. service=AccessControlService 2023-09-23 22:01:43,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:01:43,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:01:43,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:43,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:43,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:43,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:43,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:43,111 INFO [StoreOpener-4fb2369c23b67da245764b130beec122-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,111 INFO [StoreOpener-d0ea78c7f5e6040e90873a5c4ef44e3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:43,117 DEBUG [StoreOpener-4fb2369c23b67da245764b130beec122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/cf 2023-09-23 22:01:43,117 DEBUG [StoreOpener-4fb2369c23b67da245764b130beec122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/cf 2023-09-23 22:01:43,117 DEBUG [StoreOpener-d0ea78c7f5e6040e90873a5c4ef44e3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/cf 2023-09-23 22:01:43,117 DEBUG [StoreOpener-d0ea78c7f5e6040e90873a5c4ef44e3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/cf 2023-09-23 22:01:43,118 INFO [StoreOpener-4fb2369c23b67da245764b130beec122-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fb2369c23b67da245764b130beec122 columnFamilyName cf 2023-09-23 22:01:43,118 INFO [StoreOpener-d0ea78c7f5e6040e90873a5c4ef44e3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0ea78c7f5e6040e90873a5c4ef44e3b columnFamilyName cf 2023-09-23 22:01:43,118 INFO [StoreOpener-4fb2369c23b67da245764b130beec122-1] regionserver.HStore(310): Store=4fb2369c23b67da245764b130beec122/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:01:43,118 INFO [StoreOpener-d0ea78c7f5e6040e90873a5c4ef44e3b-1] regionserver.HStore(310): Store=d0ea78c7f5e6040e90873a5c4ef44e3b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:01:43,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:43,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:43,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:43,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:01:43,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:01:43,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d0ea78c7f5e6040e90873a5c4ef44e3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71771017, jitterRate=0.06947149336338043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:01:43,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4fb2369c23b67da245764b130beec122; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70091231, jitterRate=0.04444073140621185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:01:43,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d0ea78c7f5e6040e90873a5c4ef44e3b: 2023-09-23 22:01:43,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4fb2369c23b67da245764b130beec122: 2023-09-23 22:01:43,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b., pid=69, masterSystemTime=1695506503092 2023-09-23 22:01:43,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122., pid=70, masterSystemTime=1695506503092 2023-09-23 22:01:43,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:43,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:43,128 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d0ea78c7f5e6040e90873a5c4ef44e3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:43,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:43,128 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506503128"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506503128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506503128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506503128"}]},"ts":"1695506503128"} 2023-09-23 22:01:43,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:43,129 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4fb2369c23b67da245764b130beec122, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:43,129 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506503129"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506503129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506503129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506503129"}]},"ts":"1695506503129"} 2023-09-23 22:01:43,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-23 22:01:43,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure d0ea78c7f5e6040e90873a5c4ef44e3b, server=jenkins-hbase20.apache.org,45419,1695506434840 in 189 msec 2023-09-23 22:01:43,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-23 22:01:43,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 4fb2369c23b67da245764b130beec122, server=jenkins-hbase20.apache.org,38977,1695506434881 in 189 msec 2023-09-23 22:01:43,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0ea78c7f5e6040e90873a5c4ef44e3b, ASSIGN in 352 msec 2023-09-23 22:01:43,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-23 22:01:43,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4fb2369c23b67da245764b130beec122, ASSIGN in 352 msec 2023-09-23 22:01:43,133 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 22:01:43,133 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506503133"}]},"ts":"1695506503133"} 2023-09-23 22:01:43,134 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-23 22:01:43,135 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 22:01:43,136 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-23 22:01:43,137 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-23 22:01:43,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:43,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:43,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:43,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:43,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:43,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:43,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:43,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:43,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:43,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:43,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:43,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:43,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 406 msec 2023-09-23 22:01:43,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 22:01:43,346 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-23 22:01:43,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions d0ea78c7f5e6040e90873a5c4ef44e3b, 4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0ea78c7f5e6040e90873a5c4ef44e3b, 4fb2369c23b67da245764b130beec122], force=true 2023-09-23 22:01:43,381 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0ea78c7f5e6040e90873a5c4ef44e3b, 4fb2369c23b67da245764b130beec122], force=true 2023-09-23 22:01:43,381 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0ea78c7f5e6040e90873a5c4ef44e3b, 4fb2369c23b67da245764b130beec122], force=true 2023-09-23 22:01:43,381 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0ea78c7f5e6040e90873a5c4ef44e3b, 4fb2369c23b67da245764b130beec122], force=true 2023-09-23 22:01:43,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 22:01:43,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0ea78c7f5e6040e90873a5c4ef44e3b, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4fb2369c23b67da245764b130beec122, UNASSIGN}] 2023-09-23 22:01:43,405 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0ea78c7f5e6040e90873a5c4ef44e3b, UNASSIGN 2023-09-23 22:01:43,405 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4fb2369c23b67da245764b130beec122, UNASSIGN 2023-09-23 22:01:43,406 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4fb2369c23b67da245764b130beec122, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:43,406 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d0ea78c7f5e6040e90873a5c4ef44e3b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:43,406 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506503406"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506503406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506503406"}]},"ts":"1695506503406"} 2023-09-23 22:01:43,406 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506503406"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506503406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506503406"}]},"ts":"1695506503406"} 2023-09-23 22:01:43,408 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure d0ea78c7f5e6040e90873a5c4ef44e3b, server=jenkins-hbase20.apache.org,45419,1695506434840}] 2023-09-23 22:01:43,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 4fb2369c23b67da245764b130beec122, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:01:43,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 22:01:43,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:43,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4fb2369c23b67da245764b130beec122, disabling compactions & flushes 2023-09-23 22:01:43,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d0ea78c7f5e6040e90873a5c4ef44e3b, disabling compactions & flushes 2023-09-23 22:01:43,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:43,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:43,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:43,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:43,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. after waiting 0 ms 2023-09-23 22:01:43,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. after waiting 0 ms 2023-09-23 22:01:43,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:43,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:43,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 4fb2369c23b67da245764b130beec122 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-23 22:01:43,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing d0ea78c7f5e6040e90873a5c4ef44e3b 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-23 22:01:43,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/.tmp/cf/f4ca3f15c987476390c5cf2fca0bb894 2023-09-23 22:01:43,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/.tmp/cf/e3a6271fe6f64cf08208502763bb045b 2023-09-23 22:01:43,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/.tmp/cf/f4ca3f15c987476390c5cf2fca0bb894 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/cf/f4ca3f15c987476390c5cf2fca0bb894 2023-09-23 22:01:43,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/.tmp/cf/e3a6271fe6f64cf08208502763bb045b as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/cf/e3a6271fe6f64cf08208502763bb045b 2023-09-23 22:01:43,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/cf/e3a6271fe6f64cf08208502763bb045b, entries=1, sequenceid=5, filesize=4.7 K 2023-09-23 22:01:43,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/cf/f4ca3f15c987476390c5cf2fca0bb894, entries=1, sequenceid=5, filesize=4.7 K 2023-09-23 22:01:43,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 4fb2369c23b67da245764b130beec122 in 30ms, sequenceid=5, compaction requested=false 2023-09-23 22:01:43,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 22:01:43,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d0ea78c7f5e6040e90873a5c4ef44e3b in 30ms, sequenceid=5, compaction requested=false 2023-09-23 22:01:43,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 22:01:43,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-23 22:01:43,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-23 22:01:43,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:01:43,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:01:43,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b. 2023-09-23 22:01:43,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122. 2023-09-23 22:01:43,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d0ea78c7f5e6040e90873a5c4ef44e3b: 2023-09-23 22:01:43,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4fb2369c23b67da245764b130beec122: 2023-09-23 22:01:43,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:43,609 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d0ea78c7f5e6040e90873a5c4ef44e3b, regionState=CLOSED 2023-09-23 22:01:43,610 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506503609"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506503609"}]},"ts":"1695506503609"} 2023-09-23 22:01:43,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 4fb2369c23b67da245764b130beec122 2023-09-23 22:01:43,610 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4fb2369c23b67da245764b130beec122, regionState=CLOSED 2023-09-23 22:01:43,610 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695506503610"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506503610"}]},"ts":"1695506503610"} 2023-09-23 22:01:43,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-23 22:01:43,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure d0ea78c7f5e6040e90873a5c4ef44e3b, server=jenkins-hbase20.apache.org,45419,1695506434840 in 203 msec 2023-09-23 22:01:43,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-23 22:01:43,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 4fb2369c23b67da245764b130beec122, server=jenkins-hbase20.apache.org,38977,1695506434881 in 204 msec 2023-09-23 22:01:43,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d0ea78c7f5e6040e90873a5c4ef44e3b, UNASSIGN in 214 msec 2023-09-23 22:01:43,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-23 22:01:43,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4fb2369c23b67da245764b130beec122, UNASSIGN in 211 msec 2023-09-23 22:01:43,658 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-23 22:01:43,660 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502733.d0ea78c7f5e6040e90873a5c4ef44e3b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:43,660 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695506502733.4fb2369c23b67da245764b130beec122.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:43,660 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:43,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 22:01:43,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6e374b292de46f3117dc016a0890686, ASSIGN}] 2023-09-23 22:01:43,702 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6e374b292de46f3117dc016a0890686, ASSIGN 2023-09-23 22:01:43,702 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6e374b292de46f3117dc016a0890686, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,45419,1695506434840; forceNewPlan=false, retain=false 2023-09-23 22:01:43,853 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 22:01:43,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c6e374b292de46f3117dc016a0890686, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:43,855 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695506503855"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506503855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506503855"}]},"ts":"1695506503855"} 2023-09-23 22:01:43,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure c6e374b292de46f3117dc016a0890686, server=jenkins-hbase20.apache.org,45419,1695506434840}] 2023-09-23 22:01:43,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 22:01:44,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. 2023-09-23 22:01:44,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c6e374b292de46f3117dc016a0890686, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.', STARTKEY => '', ENDKEY => ''} 2023-09-23 22:01:44,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. service=AccessControlService 2023-09-23 22:01:44,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:01:44,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:44,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:44,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:44,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:44,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/.regioninfo 2023-09-23 22:01:44,033 INFO [StoreOpener-c6e374b292de46f3117dc016a0890686-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:44,034 DEBUG [StoreOpener-c6e374b292de46f3117dc016a0890686-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf 2023-09-23 22:01:44,034 DEBUG [StoreOpener-c6e374b292de46f3117dc016a0890686-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf 2023-09-23 22:01:44,035 INFO [StoreOpener-c6e374b292de46f3117dc016a0890686-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6e374b292de46f3117dc016a0890686 columnFamilyName cf 2023-09-23 22:01:44,060 DEBUG [StoreOpener-c6e374b292de46f3117dc016a0890686-1] regionserver.HStore(539): loaded hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/e3a6271fe6f64cf08208502763bb045b.d0ea78c7f5e6040e90873a5c4ef44e3b->hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/cf/e3a6271fe6f64cf08208502763bb045b-top 2023-09-23 22:01:44,065 DEBUG [StoreOpener-c6e374b292de46f3117dc016a0890686-1] regionserver.HStore(539): loaded hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/f4ca3f15c987476390c5cf2fca0bb894.4fb2369c23b67da245764b130beec122->hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/cf/f4ca3f15c987476390c5cf2fca0bb894-top 2023-09-23 22:01:44,066 INFO [StoreOpener-c6e374b292de46f3117dc016a0890686-1] regionserver.HStore(310): Store=c6e374b292de46f3117dc016a0890686/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:01:44,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:44,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:44,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:44,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c6e374b292de46f3117dc016a0890686; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65647805, jitterRate=-0.021771475672721863}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:01:44,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c6e374b292de46f3117dc016a0890686: 2023-09-23 22:01:44,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686., pid=77, masterSystemTime=1695506504010 2023-09-23 22:01:44,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.,because compaction is disabled. 2023-09-23 22:01:44,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. 2023-09-23 22:01:44,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. 2023-09-23 22:01:44,074 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c6e374b292de46f3117dc016a0890686, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,075 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695506504074"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506504074"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506504074"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506504074"}]},"ts":"1695506504074"} 2023-09-23 22:01:44,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-23 22:01:44,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure c6e374b292de46f3117dc016a0890686, server=jenkins-hbase20.apache.org,45419,1695506434840 in 219 msec 2023-09-23 22:01:44,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-23 22:01:44,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6e374b292de46f3117dc016a0890686, ASSIGN in 376 msec 2023-09-23 22:01:44,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d0ea78c7f5e6040e90873a5c4ef44e3b, 4fb2369c23b67da245764b130beec122], force=true in 704 msec 2023-09-23 22:01:44,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 22:01:44,491 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-23 22:01:44,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 22:01:44,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506504492 (current time:1695506504492). 2023-09-23 22:01:44,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:01:44,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x577bb7ff to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:44,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6101c42c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:44,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:44,508 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:44,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x577bb7ff to 127.0.0.1:58910 2023-09-23 22:01:44,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:44,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x4231e828 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:44,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48ff7bde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:44,523 DEBUG [hconnection-0x2730e649-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:44,527 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:44,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:44,538 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:44,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4231e828 to 127.0.0.1:58910 2023-09-23 22:01:44,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:44,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-23 22:01:44,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:01:44,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 22:01:44,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 22:01:44,545 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 22:01:44,546 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695507104546 2023-09-23 22:01:44,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 22:01:44,546 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,549 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:01:44,550 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:01:44,551 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 22:01:44,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 22:01:44,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-09-23 22:01:44,553 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 22:01:44,553 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695507104553 2023-09-23 22:01:44,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,567 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 22:01:44,567 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:44,568 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-23 22:01:44,568 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-23 22:01:44,568 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,568 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,569 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:44,569 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:44,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:44,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:44,569 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,569 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:44,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,570 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,570 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 22:01:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,571 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 22:01:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 22:01:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,571 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 22:01:44,571 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 22:01:44,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,571 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 22:01:44,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,571 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:44,571 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 22:01:44,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,572 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:44,572 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 22:01:44,574 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 22:01:44,574 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 22:01:44,574 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 22:01:44,574 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 22:01:44,572 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 22:01:44,574 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 22:01:44,574 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:44,575 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 22:01:44,575 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 22:01:44,575 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 22:01:44,576 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:44,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:44,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:44,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:44,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-23 22:01:44,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@680fe550[Count = 0] remaining members to acquire global barrier 2023-09-23 22:01:44,578 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-23 22:01:44,578 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,579 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:01:44,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 22:01:44,579 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 22:01:44,579 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 22:01:44,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,579 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:44,579 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:44,579 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 22:01:44,579 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 22:01:44,579 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:01:44,579 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:01:44,579 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. 2023-09-23 22:01:44,580 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. started... 2023-09-23 22:01:44,581 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c6e374b292de46f3117dc016a0890686: 2023-09-23 22:01:44,581 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,581 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:44,581 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/e3a6271fe6f64cf08208502763bb045b.d0ea78c7f5e6040e90873a5c4ef44e3b->hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/cf/e3a6271fe6f64cf08208502763bb045b-top, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/f4ca3f15c987476390c5cf2fca0bb894.4fb2369c23b67da245764b130beec122->hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/cf/f4ca3f15c987476390c5cf2fca0bb894-top] hfiles 2023-09-23 22:01:44,581 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/e3a6271fe6f64cf08208502763bb045b.d0ea78c7f5e6040e90873a5c4ef44e3b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,582 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 22:01:44,582 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:44,582 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 22:01:44,583 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 22:01:44,583 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:44,583 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 22:01:44,586 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/f4ca3f15c987476390c5cf2fca0bb894.4fb2369c23b67da245764b130beec122 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,592 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. completed. 2023-09-23 22:01:44,593 DEBUG [rs(jenkins-hbase20.apache.org,45419,1695506434840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. 2023-09-23 22:01:44,593 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:44,593 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:44,593 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,593 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 22:01:44,593 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:01:44,596 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 22:01:44,597 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,597 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:44,597 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 22:01:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,45419,1695506434840': 2023-09-23 22:01:44,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-23 22:01:44,601 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-23 22:01:44,601 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:01:44,601 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:01:44,601 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,601 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:01:44,603 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:44,603 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:44,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:44,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:44,604 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:44,604 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:44,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:44,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,604 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:44,607 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:44,607 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,607 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:44,612 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:44,612 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:44,612 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:44,612 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:44,612 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,612 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:44,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,612 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:44,612 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:44,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:44,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:44,612 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:44,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:44,612 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:44,613 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,613 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:44,614 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:44,614 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:44,614 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:44,614 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:44,614 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,614 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-23 22:01:44,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,634 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695506504546Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695506504612 (+66 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695506504614 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695506504619 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695506504627 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695506504633 (+6 ms) 2023-09-23 22:01:44,636 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 22:01:44,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 87 msec 2023-09-23 22:01:44,650 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:44,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-23 22:01:44,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:01:44,651 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651 2023-09-23 22:01:44,651 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45753, tgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651, rawTgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651, srcFsUri=hdfs://localhost:45753, srcDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:01:44,668 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:01:44,668 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-885252019_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,668 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523, snapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-23 22:01:44,677 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:44,693 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:44,693 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:44,693 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:44,694 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:45,400 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-2612342677317870671.jar 2023-09-23 22:01:45,400 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:45,401 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:45,454 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-7177700826497345964.jar 2023-09-23 22:01:45,454 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:45,454 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:45,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:45,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:45,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:45,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:45,456 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 22:01:45,456 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 22:01:45,456 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 22:01:45,457 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 22:01:45,457 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 22:01:45,457 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 22:01:45,458 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 22:01:45,458 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 22:01:45,458 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 22:01:45,459 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 22:01:45,459 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:45,459 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:45,460 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:45,460 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:45,460 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:45,460 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:45,461 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:45,808 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0004_000001 (auth:SIMPLE) 2023-09-23 22:01:45,834 WARN [Listener at jenkins-hbase20.apache.org/38553] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 22:01:45,836 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-23 22:01:45,837 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-23 22:01:45,893 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:01:45,894 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:01:46,438 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0005_000001 (auth:SIMPLE) 2023-09-23 22:01:46,624 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 22:01:49,735 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0005_000001 (auth:SIMPLE) 2023-09-23 22:01:51,940 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0005_000001 (auth:SIMPLE) 2023-09-23 22:01:54,469 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0005_000001 (auth:SIMPLE) 2023-09-23 22:01:56,017 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 22:01:56,019 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 22:01:56,027 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,027 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 22:01:56,027 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 22:01:56,027 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,028 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-23 22:01:56,028 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-23 22:01:56,028 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,028 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-23 22:01:56,028 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506504651/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-23 22:01:56,033 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 22:01:56,037 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506516037"}]},"ts":"1695506516037"} 2023-09-23 22:01:56,038 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-23 22:01:56,136 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-23 22:01:56,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6e374b292de46f3117dc016a0890686, UNASSIGN}] 2023-09-23 22:01:56,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 22:01:56,143 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6e374b292de46f3117dc016a0890686, UNASSIGN 2023-09-23 22:01:56,145 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c6e374b292de46f3117dc016a0890686, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:56,146 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695506516145"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506516145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506516145"}]},"ts":"1695506516145"} 2023-09-23 22:01:56,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure c6e374b292de46f3117dc016a0890686, server=jenkins-hbase20.apache.org,45419,1695506434840}] 2023-09-23 22:01:56,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:56,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c6e374b292de46f3117dc016a0890686, disabling compactions & flushes 2023-09-23 22:01:56,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. 2023-09-23 22:01:56,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. 2023-09-23 22:01:56,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. after waiting 0 ms 2023-09-23 22:01:56,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. 2023-09-23 22:01:56,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-23 22:01:56,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:01:56,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686. 2023-09-23 22:01:56,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c6e374b292de46f3117dc016a0890686: 2023-09-23 22:01:56,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:56,327 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c6e374b292de46f3117dc016a0890686, regionState=CLOSED 2023-09-23 22:01:56,327 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695506516327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506516327"}]},"ts":"1695506516327"} 2023-09-23 22:01:56,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-23 22:01:56,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure c6e374b292de46f3117dc016a0890686, server=jenkins-hbase20.apache.org,45419,1695506434840 in 181 msec 2023-09-23 22:01:56,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-23 22:01:56,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6e374b292de46f3117dc016a0890686, UNASSIGN in 192 msec 2023-09-23 22:01:56,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506516332"}]},"ts":"1695506516332"} 2023-09-23 22:01:56,333 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-23 22:01:56,335 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-23 22:01:56,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 301 msec 2023-09-23 22:01:56,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 22:01:56,341 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-23 22:01:56,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,344 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,345 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,346 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,348 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:56,348 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:56,348 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122 2023-09-23 22:01:56,350 DEBUG [HFileArchiver-17] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/recovered.edits] 2023-09-23 22:01:56,350 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/recovered.edits] 2023-09-23 22:01:56,350 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/recovered.edits] 2023-09-23 22:01:56,353 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/e3a6271fe6f64cf08208502763bb045b.d0ea78c7f5e6040e90873a5c4ef44e3b to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/e3a6271fe6f64cf08208502763bb045b.d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:56,353 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/cf/f4ca3f15c987476390c5cf2fca0bb894 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/cf/f4ca3f15c987476390c5cf2fca0bb894 2023-09-23 22:01:56,353 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/cf/e3a6271fe6f64cf08208502763bb045b to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/cf/e3a6271fe6f64cf08208502763bb045b 2023-09-23 22:01:56,354 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/f4ca3f15c987476390c5cf2fca0bb894.4fb2369c23b67da245764b130beec122 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/cf/f4ca3f15c987476390c5cf2fca0bb894.4fb2369c23b67da245764b130beec122 2023-09-23 22:01:56,356 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/recovered.edits/8.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b/recovered.edits/8.seqid 2023-09-23 22:01:56,356 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/recovered.edits/8.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122/recovered.edits/8.seqid 2023-09-23 22:01:56,357 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d0ea78c7f5e6040e90873a5c4ef44e3b 2023-09-23 22:01:56,357 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4fb2369c23b67da245764b130beec122 2023-09-23 22:01:56,358 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/recovered.edits/12.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686/recovered.edits/12.seqid 2023-09-23 22:01:56,358 DEBUG [HFileArchiver-17] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6e374b292de46f3117dc016a0890686 2023-09-23 22:01:56,358 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-23 22:01:56,360 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,362 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,362 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,362 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,362 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 22:01:56,363 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-23 22:01:56,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 22:01:56,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 22:01:56,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 22:01:56,363 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,363 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,363 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,363 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:56,363 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:56,363 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,364 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:56,364 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:56,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-23 22:01:56,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:56,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:56,365 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-23 22:01:56,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:56,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:56,366 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,366 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-23 22:01:56,366 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506516366"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:56,368 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-23 22:01:56,368 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c6e374b292de46f3117dc016a0890686, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695506502734.c6e374b292de46f3117dc016a0890686.', STARTKEY => '', ENDKEY => ''}] 2023-09-23 22:01:56,368 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-23 22:01:56,368 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695506516368"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:56,370 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-23 22:01:56,371 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 30 msec 2023-09-23 22:01:56,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-23 22:01:56,466 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-23 22:01:56,467 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 22:01:56,474 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506516474"}]},"ts":"1695506516474"} 2023-09-23 22:01:56,476 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-23 22:01:56,478 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-23 22:01:56,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=869151733feb9b398089e9d109423d1d, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=289a73d6398cc8c8831e1cfcd2984874, UNASSIGN}] 2023-09-23 22:01:56,481 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=289a73d6398cc8c8831e1cfcd2984874, UNASSIGN 2023-09-23 22:01:56,481 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=869151733feb9b398089e9d109423d1d, UNASSIGN 2023-09-23 22:01:56,482 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=289a73d6398cc8c8831e1cfcd2984874, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:56,482 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=869151733feb9b398089e9d109423d1d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:56,482 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506516482"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506516482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506516482"}]},"ts":"1695506516482"} 2023-09-23 22:01:56,482 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506516482"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506516482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506516482"}]},"ts":"1695506516482"} 2023-09-23 22:01:56,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 289a73d6398cc8c8831e1cfcd2984874, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:01:56,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 869151733feb9b398089e9d109423d1d, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:01:56,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 22:01:56,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:56,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 869151733feb9b398089e9d109423d1d 2023-09-23 22:01:56,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 289a73d6398cc8c8831e1cfcd2984874, disabling compactions & flushes 2023-09-23 22:01:56,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:56,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 869151733feb9b398089e9d109423d1d, disabling compactions & flushes 2023-09-23 22:01:56,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:56,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:56,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. after waiting 0 ms 2023-09-23 22:01:56,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:56,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:56,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. after waiting 0 ms 2023-09-23 22:01:56,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:56,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:01:56,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:01:56,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:01:56,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:01:56,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874. 2023-09-23 22:01:56,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d. 2023-09-23 22:01:56,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 869151733feb9b398089e9d109423d1d: 2023-09-23 22:01:56,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 289a73d6398cc8c8831e1cfcd2984874: 2023-09-23 22:01:56,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:56,656 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=289a73d6398cc8c8831e1cfcd2984874, regionState=CLOSED 2023-09-23 22:01:56,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 869151733feb9b398089e9d109423d1d 2023-09-23 22:01:56,656 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506516656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506516656"}]},"ts":"1695506516656"} 2023-09-23 22:01:56,657 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=869151733feb9b398089e9d109423d1d, regionState=CLOSED 2023-09-23 22:01:56,657 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695506516657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506516657"}]},"ts":"1695506516657"} 2023-09-23 22:01:56,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-23 22:01:56,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 289a73d6398cc8c8831e1cfcd2984874, server=jenkins-hbase20.apache.org,38977,1695506434881 in 175 msec 2023-09-23 22:01:56,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-23 22:01:56,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 869151733feb9b398089e9d109423d1d, server=jenkins-hbase20.apache.org,44169,1695506434796 in 174 msec 2023-09-23 22:01:56,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=289a73d6398cc8c8831e1cfcd2984874, UNASSIGN in 180 msec 2023-09-23 22:01:56,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-23 22:01:56,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=869151733feb9b398089e9d109423d1d, UNASSIGN in 181 msec 2023-09-23 22:01:56,662 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506516662"}]},"ts":"1695506516662"} 2023-09-23 22:01:56,663 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-23 22:01:56,664 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-23 22:01:56,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 196 msec 2023-09-23 22:01:56,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 22:01:56,779 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-23 22:01:56,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,789 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,790 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,792 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,794 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,794 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,794 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,794 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 22:01:56,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 22:01:56,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 22:01:56,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 22:01:56,795 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,795 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,795 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:56,795 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,795 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,795 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:56,795 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:56,795 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:56,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-23 22:01:56,796 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d 2023-09-23 22:01:56,796 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:56,798 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/recovered.edits] 2023-09-23 22:01:56,798 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/recovered.edits] 2023-09-23 22:01:56,801 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/cf/3407d7fcf8fc48bb93b2c126296045cb to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/cf/3407d7fcf8fc48bb93b2c126296045cb 2023-09-23 22:01:56,802 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/cf/1a42e5c6fa7040d4832476c2e32cf340 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/cf/1a42e5c6fa7040d4832476c2e32cf340 2023-09-23 22:01:56,804 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d/recovered.edits/9.seqid 2023-09-23 22:01:56,804 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874/recovered.edits/9.seqid 2023-09-23 22:01:56,805 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/869151733feb9b398089e9d109423d1d 2023-09-23 22:01:56,805 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/289a73d6398cc8c8831e1cfcd2984874 2023-09-23 22:01:56,805 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-23 22:01:56,805 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-23 22:01:56,806 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-23 22:01:56,809 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309236c06a89769674aa4b7e4806027ae8d75 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309236c06a89769674aa4b7e4806027ae8d75 2023-09-23 22:01:56,810 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092397a0ab7c4d4e44b382344d40480ab4e2 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092397a0ab7c4d4e44b382344d40480ab4e2 2023-09-23 22:01:56,811 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-23 22:01:56,813 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,816 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-23 22:01:56,819 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-23 22:01:56,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-23 22:01:56,821 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506516821"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:56,821 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506516821"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:56,823 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 22:01:56,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 869151733feb9b398089e9d109423d1d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695506501350.869151733feb9b398089e9d109423d1d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 289a73d6398cc8c8831e1cfcd2984874, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695506501350.289a73d6398cc8c8831e1cfcd2984874.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 22:01:56,823 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-23 22:01:56,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695506516823"}]},"ts":"9223372036854775807"} 2023-09-23 22:01:56,826 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-23 22:01:56,827 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 45 msec 2023-09-23 22:01:56,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-23 22:01:56,898 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-23 22:01:56,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-23 22:01:56,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-23 22:01:56,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 22:01:56,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-23 22:01:56,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 22:01:56,957 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=764 (was 763) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:57694 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:60386 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase20.apache.org/148.251.75.209:34679 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x33baf094-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:39566 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_17318192_1 at /127.0.0.1:60374 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4072 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 216), ProcessCount=166 (was 166), AvailableMemoryMB=7166 (was 7302) 2023-09-23 22:01:56,957 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-23 22:01:56,979 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=166, AvailableMemoryMB=7166 2023-09-23 22:01:56,979 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-23 22:01:56,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 22:01:56,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 22:01:56,985 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 22:01:56,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-23 22:01:56,986 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 22:01:56,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 22:01:56,989 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:01:56,989 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:01:56,989 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee empty. 2023-09-23 22:01:56,989 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6 empty. 2023-09-23 22:01:56,990 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:01:56,990 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:01:56,990 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-23 22:01:56,999 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-23 22:01:57,000 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => bcfdfef03fe2af7aae207177bcd487a6, NAME => 'testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:01:57,000 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6c2d14a52c352ba306c1f28fc9abc1ee, NAME => 'testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing bcfdfef03fe2af7aae207177bcd487a6, disabling compactions & flushes 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6c2d14a52c352ba306c1f28fc9abc1ee, disabling compactions & flushes 2023-09-23 22:01:57,021 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:57,021 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. after waiting 0 ms 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. after waiting 0 ms 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,021 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:57,021 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6c2d14a52c352ba306c1f28fc9abc1ee: 2023-09-23 22:01:57,021 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for bcfdfef03fe2af7aae207177bcd487a6: 2023-09-23 22:01:57,023 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 22:01:57,023 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506517023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506517023"}]},"ts":"1695506517023"} 2023-09-23 22:01:57,024 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506517023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506517023"}]},"ts":"1695506517023"} 2023-09-23 22:01:57,025 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 22:01:57,026 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 22:01:57,026 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506517026"}]},"ts":"1695506517026"} 2023-09-23 22:01:57,027 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-23 22:01:57,029 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:01:57,030 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:01:57,030 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:01:57,030 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:01:57,030 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:01:57,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bcfdfef03fe2af7aae207177bcd487a6, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c2d14a52c352ba306c1f28fc9abc1ee, ASSIGN}] 2023-09-23 22:01:57,032 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c2d14a52c352ba306c1f28fc9abc1ee, ASSIGN 2023-09-23 22:01:57,032 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bcfdfef03fe2af7aae207177bcd487a6, ASSIGN 2023-09-23 22:01:57,033 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c2d14a52c352ba306c1f28fc9abc1ee, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38977,1695506434881; forceNewPlan=false, retain=false 2023-09-23 22:01:57,033 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bcfdfef03fe2af7aae207177bcd487a6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44169,1695506434796; forceNewPlan=false, retain=false 2023-09-23 22:01:57,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 22:01:57,183 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 22:01:57,189 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=bcfdfef03fe2af7aae207177bcd487a6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,189 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6c2d14a52c352ba306c1f28fc9abc1ee, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,190 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506517189"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506517189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506517189"}]},"ts":"1695506517189"} 2023-09-23 22:01:57,190 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506517189"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506517189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506517189"}]},"ts":"1695506517189"} 2023-09-23 22:01:57,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure bcfdfef03fe2af7aae207177bcd487a6, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:01:57,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 6c2d14a52c352ba306c1f28fc9abc1ee, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:01:57,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 22:01:57,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:57,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c2d14a52c352ba306c1f28fc9abc1ee, NAME => 'testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 22:01:57,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bcfdfef03fe2af7aae207177bcd487a6, NAME => 'testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 22:01:57,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. service=AccessControlService 2023-09-23 22:01:57,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. service=AccessControlService 2023-09-23 22:01:57,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:01:57,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:01:57,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:01:57,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:01:57,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:57,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:01:57,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:01:57,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:01:57,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:01:57,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:01:57,351 INFO [StoreOpener-6c2d14a52c352ba306c1f28fc9abc1ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:01:57,351 INFO [StoreOpener-bcfdfef03fe2af7aae207177bcd487a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:01:57,353 DEBUG [StoreOpener-6c2d14a52c352ba306c1f28fc9abc1ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/cf 2023-09-23 22:01:57,353 DEBUG [StoreOpener-bcfdfef03fe2af7aae207177bcd487a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/cf 2023-09-23 22:01:57,353 DEBUG [StoreOpener-bcfdfef03fe2af7aae207177bcd487a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/cf 2023-09-23 22:01:57,353 DEBUG [StoreOpener-6c2d14a52c352ba306c1f28fc9abc1ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/cf 2023-09-23 22:01:57,353 INFO [StoreOpener-6c2d14a52c352ba306c1f28fc9abc1ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c2d14a52c352ba306c1f28fc9abc1ee columnFamilyName cf 2023-09-23 22:01:57,353 INFO [StoreOpener-bcfdfef03fe2af7aae207177bcd487a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcfdfef03fe2af7aae207177bcd487a6 columnFamilyName cf 2023-09-23 22:01:57,355 INFO [StoreOpener-bcfdfef03fe2af7aae207177bcd487a6-1] regionserver.HStore(310): Store=bcfdfef03fe2af7aae207177bcd487a6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:01:57,355 INFO [StoreOpener-6c2d14a52c352ba306c1f28fc9abc1ee-1] regionserver.HStore(310): Store=6c2d14a52c352ba306c1f28fc9abc1ee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:01:57,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:01:57,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:01:57,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:01:57,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:01:57,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:01:57,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:01:57,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:01:57,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:01:57,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bcfdfef03fe2af7aae207177bcd487a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74383044, jitterRate=0.10839372873306274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:01:57,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6c2d14a52c352ba306c1f28fc9abc1ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73493960, jitterRate=0.0951453447341919}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:01:57,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bcfdfef03fe2af7aae207177bcd487a6: 2023-09-23 22:01:57,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6c2d14a52c352ba306c1f28fc9abc1ee: 2023-09-23 22:01:57,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6., pid=93, masterSystemTime=1695506517346 2023-09-23 22:01:57,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee., pid=94, masterSystemTime=1695506517346 2023-09-23 22:01:57,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:57,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:57,364 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6c2d14a52c352ba306c1f28fc9abc1ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,365 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506517364"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506517364"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506517364"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506517364"}]},"ts":"1695506517364"} 2023-09-23 22:01:57,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,365 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=bcfdfef03fe2af7aae207177bcd487a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,365 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506517365"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506517365"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506517365"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506517365"}]},"ts":"1695506517365"} 2023-09-23 22:01:57,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-23 22:01:57,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 6c2d14a52c352ba306c1f28fc9abc1ee, server=jenkins-hbase20.apache.org,38977,1695506434881 in 172 msec 2023-09-23 22:01:57,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-23 22:01:57,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure bcfdfef03fe2af7aae207177bcd487a6, server=jenkins-hbase20.apache.org,44169,1695506434796 in 172 msec 2023-09-23 22:01:57,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c2d14a52c352ba306c1f28fc9abc1ee, ASSIGN in 337 msec 2023-09-23 22:01:57,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-23 22:01:57,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bcfdfef03fe2af7aae207177bcd487a6, ASSIGN in 338 msec 2023-09-23 22:01:57,369 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 22:01:57,369 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506517369"}]},"ts":"1695506517369"} 2023-09-23 22:01:57,370 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-23 22:01:57,372 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 22:01:57,372 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-23 22:01:57,374 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 22:01:57,374 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:57,374 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:57,374 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:57,374 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:01:57,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:57,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:57,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:57,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 22:01:57,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 393 msec 2023-09-23 22:01:57,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 22:01:57,596 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-23 22:01:57,601 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-23 22:01:57,601 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,603 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:01:57,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:01:57,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506517619 (current time:1695506517619). 2023-09-23 22:01:57,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:01:57,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x37302edb to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:57,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35955c07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:57,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:57,637 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:57,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37302edb to 127.0.0.1:58910 2023-09-23 22:01:57,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:57,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x34ebc9c7 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:57,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21b6f77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:57,646 DEBUG [hconnection-0x1d717e57-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:57,650 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:57,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:57,657 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:57,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34ebc9c7 to 127.0.0.1:58910 2023-09-23 22:01:57,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:57,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 22:01:57,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:01:57,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:01:57,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:01:57,663 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:01:57,664 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695507117664 2023-09-23 22:01:57,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:01:57,664 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-23 22:01:57,666 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:01:57,666 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:01:57,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 22:01:57,667 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:01:57,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-23 22:01:57,672 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 22:01:57,673 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695507117673 2023-09-23 22:01:57,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,685 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-23 22:01:57,685 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:57,687 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-23 22:01:57,687 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-23 22:01:57,687 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,687 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,689 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:57,689 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:57,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:57,689 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,689 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:57,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:57,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:57,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:57,690 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,690 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,690 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,690 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 22:01:57,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 22:01:57,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 22:01:57,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 22:01:57,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,691 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 22:01:57,691 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 22:01:57,691 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:57,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,692 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 22:01:57,692 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 22:01:57,691 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:57,692 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:57,692 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 22:01:57,694 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 22:01:57,694 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 22:01:57,694 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 22:01:57,694 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 22:01:57,693 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 22:01:57,695 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 22:01:57,695 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 22:01:57,703 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,703 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:57,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:57,704 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,704 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,704 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,704 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,704 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:57,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:57,704 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,704 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:57,704 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,704 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:57,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:57,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:57,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 22:01:57,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707c653[Count = 1] remaining members to acquire global barrier 2023-09-23 22:01:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:57,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 22:01:57,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707c653[Count = 0] remaining members to acquire global barrier 2023-09-23 22:01:57,708 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 22:01:57,708 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:01:57,709 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:01:57,709 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,709 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 22:01:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,709 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:01:57,709 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:57,709 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:57,709 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:01:57,709 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,709 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:01:57,709 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:57,709 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,710 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. started... 2023-09-23 22:01:57,709 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:57,710 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:57,710 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. started... 2023-09-23 22:01:57,711 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c2d14a52c352ba306c1f28fc9abc1ee: 2023-09-23 22:01:57,711 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bcfdfef03fe2af7aae207177bcd487a6: 2023-09-23 22:01:57,711 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,711 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,711 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 22:01:57,711 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:57,711 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 22:01:57,711 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:57,711 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:57,712 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:01:57,712 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:01:57,720 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. completed. 2023-09-23 22:01:57,720 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. completed. 2023-09-23 22:01:57,720 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:57,720 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:01:57,720 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:01:57,721 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 22:01:57,721 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,721 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:57,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:57,721 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 22:01:57,722 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 22:01:57,722 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:57,722 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,722 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 22:01:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:57,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:01:57,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 22:01:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:01:57,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 22:01:57,730 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-23 22:01:57,730 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:01:57,730 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:01:57,730 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,730 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:01:57,736 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,736 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,736 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:57,736 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,737 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:57,736 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:57,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,736 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:57,737 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:57,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:57,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:57,738 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:57,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,738 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:57,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:57,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,742 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:57,743 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,743 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,746 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,746 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,746 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:57,746 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:57,746 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:57,746 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,747 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:57,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:57,747 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:57,747 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:57,747 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:57,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:57,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:57,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-23 22:01:57,747 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,749 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:01:57,749 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:57,749 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,749 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:57,749 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:57,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:57,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:57,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:57,749 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:57,749 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 22:01:57,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,766 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:57,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 22:01:57,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:01:57,767 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:01:57,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-23 22:01:57,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,777 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:57,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695506517664Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695506517757 (+93 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695506517757Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695506517757Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695506517760 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695506517772 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695506517777 (+5 ms) 2023-09-23 22:01:57,780 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 22:01:57,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 115 msec 2023-09-23 22:01:57,968 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:57,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 22:01:57,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:01:57,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44169] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:01:57,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38977] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:01:57,982 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-23 22:01:57,982 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:57,982 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:01:57,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:01:57,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506517992 (current time:1695506517992). 2023-09-23 22:01:57,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:01:57,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x1fc094a4 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:57,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9d5d2cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:58,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:58,003 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:58,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fc094a4 to 127.0.0.1:58910 2023-09-23 22:01:58,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:58,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x1987d253 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:01:58,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f90073, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:01:58,011 DEBUG [hconnection-0x259df95b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:58,012 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:58,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:01:58,018 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:01:58,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1987d253 to 127.0.0.1:58910 2023-09-23 22:01:58,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:01:58,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 22:01:58,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:01:58,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:01:58,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:01:58,023 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:01:58,024 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695507118024 2023-09-23 22:01:58,024 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-23 22:01:58,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 22:01:58,025 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:01:58,025 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:01:58,027 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 22:01:58,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 22:01:58,028 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-23 22:01:58,029 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 22:01:58,029 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695507118029 2023-09-23 22:01:58,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,039 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-23 22:01:58,039 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:58,040 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-23 22:01:58,040 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-23 22:01:58,041 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,041 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,041 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:58,041 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:58,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:58,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:58,041 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,041 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:58,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,042 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,042 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,042 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,042 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 22:01:58,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,043 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 22:01:58,043 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:58,046 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,048 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 22:01:58,048 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 22:01:58,048 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 22:01:58,048 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 22:01:58,048 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 22:01:58,048 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:58,048 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:01:58,049 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 22:01:58,053 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 22:01:58,054 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 22:01:58,053 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 22:01:58,054 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 22:01:58,054 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 22:01:58,054 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,056 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,056 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,056 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:58,056 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,056 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:58,056 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,056 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,056 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:58,056 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,056 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:01:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:58,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:58,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 22:01:58,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@683a5640[Count = 1] remaining members to acquire global barrier 2023-09-23 22:01:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:58,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 22:01:58,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@683a5640[Count = 0] remaining members to acquire global barrier 2023-09-23 22:01:58,059 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 22:01:58,059 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:01:58,060 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 22:01:58,060 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:01:58,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:01:58,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,060 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 22:01:58,060 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:58,060 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:58,060 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,060 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:01:58,060 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:58,060 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:01:58,060 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:01:58,060 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:58,060 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. started... 2023-09-23 22:01:58,061 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. started... 2023-09-23 22:01:58,061 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 22:01:58,061 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:58,061 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 22:01:58,062 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bcfdfef03fe2af7aae207177bcd487a6 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-23 22:01:58,062 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6c2d14a52c352ba306c1f28fc9abc1ee 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-23 22:01:58,083 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092373284a3d11c94f91a5d7d9c8568266a9 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092373284a3d11c94f91a5d7d9c8568266a9 2023-09-23 22:01:58,083 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309235c6f88a8130c4d9f8f63c46c96ac4870 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309235c6f88a8130c4d9f8f63c46c96ac4870 2023-09-23 22:01:58,096 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/.tmp/cf/a18752e013034952862cc62dc6c4fe52 2023-09-23 22:01:58,096 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/.tmp/cf/4839bce7d0c54d879379b2045e32fe0a 2023-09-23 22:01:58,101 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/.tmp/cf/4839bce7d0c54d879379b2045e32fe0a as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/cf/4839bce7d0c54d879379b2045e32fe0a 2023-09-23 22:01:58,106 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/.tmp/cf/a18752e013034952862cc62dc6c4fe52 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/cf/a18752e013034952862cc62dc6c4fe52 2023-09-23 22:01:58,108 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/cf/4839bce7d0c54d879379b2045e32fe0a, entries=48, sequenceid=6, filesize=13.2 K 2023-09-23 22:01:58,109 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 6c2d14a52c352ba306c1f28fc9abc1ee in 47ms, sequenceid=6, compaction requested=false 2023-09-23 22:01:58,109 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-23 22:01:58,109 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c2d14a52c352ba306c1f28fc9abc1ee: 2023-09-23 22:01:58,109 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,111 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:58,111 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/cf/4839bce7d0c54d879379b2045e32fe0a] hfiles 2023-09-23 22:01:58,111 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/cf/4839bce7d0c54d879379b2045e32fe0a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,113 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/cf/a18752e013034952862cc62dc6c4fe52, entries=2, sequenceid=6, filesize=5.2 K 2023-09-23 22:01:58,114 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for bcfdfef03fe2af7aae207177bcd487a6 in 53ms, sequenceid=6, compaction requested=false 2023-09-23 22:01:58,115 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bcfdfef03fe2af7aae207177bcd487a6: 2023-09-23 22:01:58,116 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,116 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:01:58,116 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/cf/a18752e013034952862cc62dc6c4fe52] hfiles 2023-09-23 22:01:58,116 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/cf/a18752e013034952862cc62dc6c4fe52 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,121 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. completed. 2023-09-23 22:01:58,121 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:01:58,121 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:58,121 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:58,121 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,121 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 22:01:58,121 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:01:58,122 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 22:01:58,122 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,122 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:58,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:58,122 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 22:01:58,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:58,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:58,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,126 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:58,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,126 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. completed. 2023-09-23 22:01:58,126 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:01:58,126 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:01:58,126 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:01:58,126 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,126 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 22:01:58,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:58,126 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:01:58,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 22:01:58,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:01:58,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,127 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:01:58,127 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,127 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 22:01:58,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,127 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:58,127 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 22:01:58,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:01:58,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 22:01:58,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:58,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:58,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:58,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:58,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:58,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:01:58,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 22:01:58,132 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-23 22:01:58,133 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:01:58,133 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:01:58,133 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,133 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:01:58,133 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,133 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,133 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:58,134 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:58,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:58,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:58,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:58,134 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,135 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:01:58,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:01:58,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,136 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,136 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:01:58,136 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:58,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:01:58,138 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:58,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:58,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:58,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:01:58,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-23 22:01:58,138 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,140 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:01:58,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,140 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:58,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:58,140 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:01:58,140 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:01:58,140 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:01:58,140 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:01:58,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:01:58,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309235c6f88a8130c4d9f8f63c46c96ac4870, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092373284a3d11c94f91a5d7d9c8568266a9] mob files 2023-09-23 22:01:58,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309235c6f88a8130c4d9f8f63c46c96ac4870 2023-09-23 22:01:58,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092373284a3d11c94f91a5d7d9c8568266a9 2023-09-23 22:01:58,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,165 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-23 22:01:58,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,166 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695506518024Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695506518146 (+122 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695506518146Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695506518147 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695506518149 (+2 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695506518157 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695506518165 (+8 ms) 2023-09-23 22:01:58,168 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 22:01:58,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 144 msec 2023-09-23 22:01:58,327 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:01:58,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 22:01:58,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:01:58,330 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330 2023-09-23 22:01:58,331 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45753, tgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330, rawTgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330, srcFsUri=hdfs://localhost:45753, srcDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:01:58,357 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:01:58,357 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-24384119_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,357 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523, snapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-23 22:01:58,362 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:01:58,782 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:58,783 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:58,783 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:58,783 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:59,491 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-8318443819763927385.jar 2023-09-23 22:01:59,492 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:59,492 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:59,545 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-791043274490957754.jar 2023-09-23 22:01:59,545 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:59,546 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:59,546 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:59,546 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:59,546 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:59,547 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 22:01:59,547 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 22:01:59,547 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 22:01:59,548 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 22:01:59,548 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 22:01:59,548 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 22:01:59,549 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 22:01:59,549 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 22:01:59,549 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 22:01:59,549 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 22:01:59,550 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 22:01:59,550 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:59,550 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:59,551 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:59,551 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:59,551 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:01:59,552 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:59,552 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:01:59,900 WARN [Listener at jenkins-hbase20.apache.org/38553] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 22:01:59,902 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-23 22:02:00,658 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:02:00,658 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:02:00,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0005_000001 (auth:SIMPLE) 2023-09-23 22:02:01,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0006_000001 (auth:SIMPLE) 2023-09-23 22:02:01,908 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 22:02:04,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0006_000001 (auth:SIMPLE) 2023-09-23 22:02:07,269 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 22:02:07,270 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 22:02:07,275 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:02:07,275 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 22:02:07,276 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 22:02:07,276 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:02:07,276 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-23 22:02:07,276 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-23 22:02:07,276 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:02:07,277 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-23 22:02:07,277 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506518330/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-23 22:02:07,282 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 22:02:07,287 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506527287"}]},"ts":"1695506527287"} 2023-09-23 22:02:07,288 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-23 22:02:07,289 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-23 22:02:07,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bcfdfef03fe2af7aae207177bcd487a6, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c2d14a52c352ba306c1f28fc9abc1ee, UNASSIGN}] 2023-09-23 22:02:07,291 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bcfdfef03fe2af7aae207177bcd487a6, UNASSIGN 2023-09-23 22:02:07,291 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c2d14a52c352ba306c1f28fc9abc1ee, UNASSIGN 2023-09-23 22:02:07,292 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=bcfdfef03fe2af7aae207177bcd487a6, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:07,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6c2d14a52c352ba306c1f28fc9abc1ee, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:07,292 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506527292"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506527292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506527292"}]},"ts":"1695506527292"} 2023-09-23 22:02:07,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506527292"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506527292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506527292"}]},"ts":"1695506527292"} 2023-09-23 22:02:07,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure bcfdfef03fe2af7aae207177bcd487a6, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:02:07,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 6c2d14a52c352ba306c1f28fc9abc1ee, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:02:07,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 22:02:07,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:02:07,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bcfdfef03fe2af7aae207177bcd487a6, disabling compactions & flushes 2023-09-23 22:02:07,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:02:07,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:02:07,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. after waiting 0 ms 2023-09-23 22:02:07,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:02:07,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:02:07,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6c2d14a52c352ba306c1f28fc9abc1ee, disabling compactions & flushes 2023-09-23 22:02:07,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:02:07,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:02:07,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. after waiting 0 ms 2023-09-23 22:02:07,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:02:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:02:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:02:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:07,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:07,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee. 2023-09-23 22:02:07,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6. 2023-09-23 22:02:07,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6c2d14a52c352ba306c1f28fc9abc1ee: 2023-09-23 22:02:07,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bcfdfef03fe2af7aae207177bcd487a6: 2023-09-23 22:02:07,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:02:07,464 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=bcfdfef03fe2af7aae207177bcd487a6, regionState=CLOSED 2023-09-23 22:02:07,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:02:07,465 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506527464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506527464"}]},"ts":"1695506527464"} 2023-09-23 22:02:07,465 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6c2d14a52c352ba306c1f28fc9abc1ee, regionState=CLOSED 2023-09-23 22:02:07,465 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695506527465"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506527465"}]},"ts":"1695506527465"} 2023-09-23 22:02:07,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-23 22:02:07,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure bcfdfef03fe2af7aae207177bcd487a6, server=jenkins-hbase20.apache.org,44169,1695506434796 in 173 msec 2023-09-23 22:02:07,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-23 22:02:07,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 6c2d14a52c352ba306c1f28fc9abc1ee, server=jenkins-hbase20.apache.org,38977,1695506434881 in 172 msec 2023-09-23 22:02:07,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bcfdfef03fe2af7aae207177bcd487a6, UNASSIGN in 178 msec 2023-09-23 22:02:07,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-23 22:02:07,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6c2d14a52c352ba306c1f28fc9abc1ee, UNASSIGN in 178 msec 2023-09-23 22:02:07,468 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506527468"}]},"ts":"1695506527468"} 2023-09-23 22:02:07,469 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-23 22:02:07,470 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-23 22:02:07,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 188 msec 2023-09-23 22:02:07,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 22:02:07,591 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-23 22:02:07,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,599 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,600 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,602 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,604 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,604 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,604 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,604 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,604 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 22:02:07,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 22:02:07,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 22:02:07,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 22:02:07,605 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,605 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,605 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:07,605 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:07,605 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,605 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:07,605 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,606 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:07,606 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:02:07,606 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:02:07,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-23 22:02:07,608 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/recovered.edits] 2023-09-23 22:02:07,608 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/recovered.edits] 2023-09-23 22:02:07,612 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/cf/4839bce7d0c54d879379b2045e32fe0a to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/cf/4839bce7d0c54d879379b2045e32fe0a 2023-09-23 22:02:07,612 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/cf/a18752e013034952862cc62dc6c4fe52 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/cf/a18752e013034952862cc62dc6c4fe52 2023-09-23 22:02:07,615 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee/recovered.edits/9.seqid 2023-09-23 22:02:07,615 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6/recovered.edits/9.seqid 2023-09-23 22:02:07,616 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/6c2d14a52c352ba306c1f28fc9abc1ee 2023-09-23 22:02:07,616 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testEmptyExportFileSystemState/bcfdfef03fe2af7aae207177bcd487a6 2023-09-23 22:02:07,616 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-23 22:02:07,616 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-23 22:02:07,617 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-23 22:02:07,620 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309235c6f88a8130c4d9f8f63c46c96ac4870 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309235c6f88a8130c4d9f8f63c46c96ac4870 2023-09-23 22:02:07,622 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092373284a3d11c94f91a5d7d9c8568266a9 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023092373284a3d11c94f91a5d7d9c8568266a9 2023-09-23 22:02:07,622 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-23 22:02:07,624 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,626 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-23 22:02:07,629 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-23 22:02:07,630 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,630 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-23 22:02:07,630 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506527630"}]},"ts":"9223372036854775807"} 2023-09-23 22:02:07,630 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506527630"}]},"ts":"9223372036854775807"} 2023-09-23 22:02:07,632 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 22:02:07,632 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bcfdfef03fe2af7aae207177bcd487a6, NAME => 'testtb-testEmptyExportFileSystemState,,1695506516981.bcfdfef03fe2af7aae207177bcd487a6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6c2d14a52c352ba306c1f28fc9abc1ee, NAME => 'testtb-testEmptyExportFileSystemState,1,1695506516981.6c2d14a52c352ba306c1f28fc9abc1ee.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 22:02:07,632 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-23 22:02:07,633 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695506527632"}]},"ts":"9223372036854775807"} 2023-09-23 22:02:07,634 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-23 22:02:07,636 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 22:02:07,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 43 msec 2023-09-23 22:02:07,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-23 22:02:07,708 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-23 22:02:07,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-23 22:02:07,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 22:02:07,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-23 22:02:07,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-23 22:02:07,741 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 764) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4844 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase20.apache.org/148.251.75.209:34343 from appattempt_1695506440948_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:48576 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase20.apache.org/148.251.75.209:34189 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_729930514_1 at /127.0.0.1:43840 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_729930514_1 at /127.0.0.1:48516 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:43862 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33baf094-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_418675957_17 at /127.0.0.1:60964 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (107704792) connection to jenkins-hbase20.apache.org/148.251.75.209:36465 from appattempt_1695506440948_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=944 (was 926) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=142 (was 168), ProcessCount=166 (was 166), AvailableMemoryMB=7117 (was 7166) 2023-09-23 22:02:07,741 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-23 22:02:07,761 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=944, MaxFileDescriptor=60000, SystemLoadAverage=142, ProcessCount=166, AvailableMemoryMB=7112 2023-09-23 22:02:07,761 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-23 22:02:07,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 22:02:07,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:07,767 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 22:02:07,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-23 22:02:07,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 22:02:07,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 22:02:07,770 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:07,770 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:07,771 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f empty. 2023-09-23 22:02:07,771 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df empty. 2023-09-23 22:02:07,771 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:07,771 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:07,771 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-23 22:02:07,785 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-23 22:02:07,786 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4686b472db9bb652465aad2f6703e12f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:02:07,786 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 366702cb1a34f77a85567a0b5acb23df, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp 2023-09-23 22:02:07,804 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:02:07,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 366702cb1a34f77a85567a0b5acb23df, disabling compactions & flushes 2023-09-23 22:02:07,805 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:07,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:07,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. after waiting 0 ms 2023-09-23 22:02:07,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:07,805 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:07,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 366702cb1a34f77a85567a0b5acb23df: 2023-09-23 22:02:07,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:02:07,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 4686b472db9bb652465aad2f6703e12f, disabling compactions & flushes 2023-09-23 22:02:07,807 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:07,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:07,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. after waiting 0 ms 2023-09-23 22:02:07,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:07,808 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:07,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 4686b472db9bb652465aad2f6703e12f: 2023-09-23 22:02:07,810 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 22:02:07,811 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506527810"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506527810"}]},"ts":"1695506527810"} 2023-09-23 22:02:07,811 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506527810"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506527810"}]},"ts":"1695506527810"} 2023-09-23 22:02:07,813 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 22:02:07,813 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 22:02:07,814 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506527813"}]},"ts":"1695506527813"} 2023-09-23 22:02:07,815 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-23 22:02:07,816 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-23 22:02:07,817 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 22:02:07,817 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 22:02:07,817 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 22:02:07,817 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 22:02:07,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4686b472db9bb652465aad2f6703e12f, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=366702cb1a34f77a85567a0b5acb23df, ASSIGN}] 2023-09-23 22:02:07,825 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4686b472db9bb652465aad2f6703e12f, ASSIGN 2023-09-23 22:02:07,826 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=366702cb1a34f77a85567a0b5acb23df, ASSIGN 2023-09-23 22:02:07,826 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4686b472db9bb652465aad2f6703e12f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44169,1695506434796; forceNewPlan=false, retain=false 2023-09-23 22:02:07,826 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=366702cb1a34f77a85567a0b5acb23df, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38977,1695506434881; forceNewPlan=false, retain=false 2023-09-23 22:02:07,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 22:02:07,977 INFO [jenkins-hbase20:36385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 22:02:07,979 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4686b472db9bb652465aad2f6703e12f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:07,979 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=366702cb1a34f77a85567a0b5acb23df, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:07,979 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506527979"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506527979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506527979"}]},"ts":"1695506527979"} 2023-09-23 22:02:07,979 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506527979"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506527979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506527979"}]},"ts":"1695506527979"} 2023-09-23 22:02:07,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 4686b472db9bb652465aad2f6703e12f, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:02:07,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 366702cb1a34f77a85567a0b5acb23df, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:02:08,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 22:02:08,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:08,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:08,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 366702cb1a34f77a85567a0b5acb23df, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 22:02:08,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4686b472db9bb652465aad2f6703e12f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. service=AccessControlService 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. service=AccessControlService 2023-09-23 22:02:08,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:02:08,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:08,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:08,137 INFO [StoreOpener-4686b472db9bb652465aad2f6703e12f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:08,137 INFO [StoreOpener-366702cb1a34f77a85567a0b5acb23df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:08,138 DEBUG [StoreOpener-4686b472db9bb652465aad2f6703e12f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/cf 2023-09-23 22:02:08,138 DEBUG [StoreOpener-4686b472db9bb652465aad2f6703e12f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/cf 2023-09-23 22:02:08,138 DEBUG [StoreOpener-366702cb1a34f77a85567a0b5acb23df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/cf 2023-09-23 22:02:08,138 DEBUG [StoreOpener-366702cb1a34f77a85567a0b5acb23df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/cf 2023-09-23 22:02:08,139 INFO [StoreOpener-4686b472db9bb652465aad2f6703e12f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4686b472db9bb652465aad2f6703e12f columnFamilyName cf 2023-09-23 22:02:08,139 INFO [StoreOpener-366702cb1a34f77a85567a0b5acb23df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 366702cb1a34f77a85567a0b5acb23df columnFamilyName cf 2023-09-23 22:02:08,139 INFO [StoreOpener-366702cb1a34f77a85567a0b5acb23df-1] regionserver.HStore(310): Store=366702cb1a34f77a85567a0b5acb23df/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:02:08,139 INFO [StoreOpener-4686b472db9bb652465aad2f6703e12f-1] regionserver.HStore(310): Store=4686b472db9bb652465aad2f6703e12f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 22:02:08,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:08,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:08,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:08,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:08,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:08,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:08,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:02:08,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 22:02:08,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4686b472db9bb652465aad2f6703e12f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73738736, jitterRate=0.09879279136657715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:02:08,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4686b472db9bb652465aad2f6703e12f: 2023-09-23 22:02:08,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 366702cb1a34f77a85567a0b5acb23df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69857692, jitterRate=0.040960729122161865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 22:02:08,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 366702cb1a34f77a85567a0b5acb23df: 2023-09-23 22:02:08,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df., pid=109, masterSystemTime=1695506528132 2023-09-23 22:02:08,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f., pid=108, masterSystemTime=1695506528132 2023-09-23 22:02:08,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:08,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:08,148 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=366702cb1a34f77a85567a0b5acb23df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:08,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:08,148 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506528148"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506528148"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506528148"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506528148"}]},"ts":"1695506528148"} 2023-09-23 22:02:08,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4686b472db9bb652465aad2f6703e12f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,149 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506528149"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695506528149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695506528149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695506528149"}]},"ts":"1695506528149"} 2023-09-23 22:02:08,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-23 22:02:08,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 366702cb1a34f77a85567a0b5acb23df, server=jenkins-hbase20.apache.org,38977,1695506434881 in 169 msec 2023-09-23 22:02:08,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-23 22:02:08,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 4686b472db9bb652465aad2f6703e12f, server=jenkins-hbase20.apache.org,44169,1695506434796 in 169 msec 2023-09-23 22:02:08,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=366702cb1a34f77a85567a0b5acb23df, ASSIGN in 333 msec 2023-09-23 22:02:08,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-23 22:02:08,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4686b472db9bb652465aad2f6703e12f, ASSIGN in 334 msec 2023-09-23 22:02:08,154 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 22:02:08,154 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506528154"}]},"ts":"1695506528154"} 2023-09-23 22:02:08,155 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-23 22:02:08,156 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 22:02:08,157 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-23 22:02:08,158 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 22:02:08,159 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:08,159 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:08,159 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:08,159 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:08,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 22:02:08,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 22:02:08,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 22:02:08,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 22:02:08,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 396 msec 2023-09-23 22:02:08,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 22:02:08,372 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-23 22:02:08,374 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,374 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:08,377 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:02:08,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 22:02:08,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506528391 (current time:1695506528391). 2023-09-23 22:02:08,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:02:08,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x584bce96 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:02:08,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e9ffa73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:02:08,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:02:08,400 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:02:08,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x584bce96 to 127.0.0.1:58910 2023-09-23 22:02:08,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:08,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x64ca4c77 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:02:08,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62730106, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:02:08,409 DEBUG [hconnection-0x431e3359-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:02:08,413 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:02:08,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:02:08,421 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:02:08,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64ca4c77 to 127.0.0.1:58910 2023-09-23 22:02:08,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:08,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 22:02:08,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:02:08,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 22:02:08,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 22:02:08,426 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 22:02:08,426 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695507128426 2023-09-23 22:02:08,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 22:02:08,426 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,428 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:02:08,428 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:02:08,429 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 22:02:08,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 22:02:08,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-23 22:02:08,431 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 22:02:08,431 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695507128431 2023-09-23 22:02:08,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,447 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-23 22:02:08,447 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:02:08,449 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-23 22:02:08,449 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-23 22:02:08,449 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,449 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,452 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,452 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,452 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,452 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,453 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,453 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,453 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,453 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 22:02:08,453 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 22:02:08,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,454 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 22:02:08,454 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 22:02:08,454 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:02:08,454 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:02:08,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,456 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 22:02:08,456 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 22:02:08,456 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 22:02:08,456 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 22:02:08,456 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:02:08,456 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 22:02:08,457 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 22:02:08,456 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 22:02:08,458 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 22:02:08,458 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 22:02:08,458 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 22:02:08,461 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,461 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,461 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,461 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,461 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,461 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:02:08,461 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,461 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,461 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:02:08,461 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,461 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:02:08,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 22:02:08,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34980064[Count = 1] remaining members to acquire global barrier 2023-09-23 22:02:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 22:02:08,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34980064[Count = 0] remaining members to acquire global barrier 2023-09-23 22:02:08,465 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-23 22:02:08,465 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,465 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,465 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,465 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,466 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 22:02:08,466 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,466 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:02:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,466 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:08,466 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 22:02:08,466 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:02:08,466 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 22:02:08,466 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:02:08,466 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:02:08,466 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:08,466 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 22:02:08,466 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. started... 2023-09-23 22:02:08,466 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,466 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:02:08,466 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:02:08,466 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. started... 2023-09-23 22:02:08,466 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4686b472db9bb652465aad2f6703e12f: 2023-09-23 22:02:08,468 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 366702cb1a34f77a85567a0b5acb23df: 2023-09-23 22:02:08,468 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,468 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:02:08,468 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,468 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:02:08,468 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:02:08,468 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 22:02:08,468 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 22:02:08,468 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:02:08,468 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 22:02:08,481 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. completed. 2023-09-23 22:02:08,481 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,481 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. completed. 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 22:02:08,481 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 22:02:08,481 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:02:08,482 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,482 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 22:02:08,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,482 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:02:08,482 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 22:02:08,482 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 22:02:08,482 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,482 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:02:08,484 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 22:02:08,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:02:08,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-23 22:02:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:02:08,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-23 22:02:08,493 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-23 22:02:08,493 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:02:08,493 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:02:08,493 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,493 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:02:08,504 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,504 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,504 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,505 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,505 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,506 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,507 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,507 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,511 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,511 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,511 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,511 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,511 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,511 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,511 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,511 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,511 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,511 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:02:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,511 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,511 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:02:08,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,513 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,513 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,513 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,514 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,514 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 22:02:08,514 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,514 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,514 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,529 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:02:08,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 22:02:08,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:02:08,530 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:02:08,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,537 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-23 22:02:08,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,537 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695506528426Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695506528519 (+93 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695506528519Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695506528520 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695506528523 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695506528532 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695506528537 (+5 ms) 2023-09-23 22:02:08,540 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 22:02:08,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 112 msec 2023-09-23 22:02:08,730 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:02:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 22:02:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:02:08,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44169] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:02:08,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38977] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 22:02:08,740 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,740 DEBUG [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:08,740 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 22:02:08,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 22:02:08,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695506528749 (current time:1695506528749). 2023-09-23 22:02:08,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 22:02:08,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x1a12b858 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:02:08,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28a4c4b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:02:08,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:02:08,760 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:02:08,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a12b858 to 127.0.0.1:58910 2023-09-23 22:02:08,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:08,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(139): Connect 0x644d2053 to 127.0.0.1:58910 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 22:02:08,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b1294fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 22:02:08,769 DEBUG [hconnection-0x659d1c24-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:02:08,776 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:02:08,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 22:02:08,784 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 22:02:08,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x644d2053 to 127.0.0.1:58910 2023-09-23 22:02:08,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:08,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 22:02:08,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 22:02:08,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 22:02:08,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 22:02:08,789 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 22:02:08,790 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695507128790 2023-09-23 22:02:08,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 22:02:08,790 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,792 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 22:02:08,793 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 22:02:08,793 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 22:02:08,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 22:02:08,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-23 22:02:08,795 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 22:02:08,795 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695507128795 2023-09-23 22:02:08,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,803 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-23 22:02:08,803 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:02:08,804 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-23 22:02:08,804 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-23 22:02:08,804 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,805 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,805 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,805 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,805 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,805 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,806 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,806 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,806 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,806 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 22:02:08,806 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 22:02:08,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 22:02:08,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,807 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 22:02:08,807 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 22:02:08,807 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:02:08,807 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:02:08,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,809 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 22:02:08,809 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 22:02:08,809 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 22:02:08,808 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 22:02:08,809 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 22:02:08,809 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 22:02:08,809 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 22:02:08,809 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 22:02:08,810 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,45419,1695506434840' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 22:02:08,809 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 22:02:08,810 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 22:02:08,810 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,812 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,812 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,812 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:02:08,812 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,812 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,812 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,812 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,812 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,812 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:02:08,812 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 22:02:08,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44169,1695506434796' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@232a56c2[Count = 1] remaining members to acquire global barrier 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38977,1695506434881' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 22:02:08,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@232a56c2[Count = 0] remaining members to acquire global barrier 2023-09-23 22:02:08,815 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-23 22:02:08,815 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,815 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,815 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,815 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,815 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,815 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 22:02:08,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,816 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,816 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 22:02:08,816 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 22:02:08,816 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:08,816 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:02:08,816 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 22:02:08,816 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:02:08,816 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:08,816 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 22:02:08,816 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. started... 2023-09-23 22:02:08,816 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 22:02:08,816 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. started... 2023-09-23 22:02:08,816 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 22:02:08,816 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4686b472db9bb652465aad2f6703e12f 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-23 22:02:08,816 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,45419,1695506434840' in zk 2023-09-23 22:02:08,816 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 366702cb1a34f77a85567a0b5acb23df 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-23 22:02:08,817 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 22:02:08,817 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:02:08,817 DEBUG [member: 'jenkins-hbase20.apache.org,45419,1695506434840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 22:02:08,833 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230923d2c56a30bde8438fbee453a981a03d87 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923d2c56a30bde8438fbee453a981a03d87 2023-09-23 22:02:08,834 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092361d8ba1694514188a6334e1e6a361f11 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092361d8ba1694514188a6334e1e6a361f11 2023-09-23 22:02:08,848 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/.tmp/cf/bbd71a22c3f94f1782a282074a508bf5 2023-09-23 22:02:08,851 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/.tmp/cf/24b3c8674bcb45618f0dfb8db2997572 2023-09-23 22:02:08,854 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/.tmp/cf/bbd71a22c3f94f1782a282074a508bf5 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/cf/bbd71a22c3f94f1782a282074a508bf5 2023-09-23 22:02:08,854 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/.tmp/cf/24b3c8674bcb45618f0dfb8db2997572 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/cf/24b3c8674bcb45618f0dfb8db2997572 2023-09-23 22:02:08,858 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/cf/24b3c8674bcb45618f0dfb8db2997572, entries=46, sequenceid=6, filesize=13.2 K 2023-09-23 22:02:08,859 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/cf/bbd71a22c3f94f1782a282074a508bf5, entries=4, sequenceid=6, filesize=5.6 K 2023-09-23 22:02:08,859 INFO [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 366702cb1a34f77a85567a0b5acb23df in 43ms, sequenceid=6, compaction requested=false 2023-09-23 22:02:08,859 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-23 22:02:08,859 INFO [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 4686b472db9bb652465aad2f6703e12f in 43ms, sequenceid=6, compaction requested=false 2023-09-23 22:02:08,860 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-23 22:02:08,862 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4686b472db9bb652465aad2f6703e12f: 2023-09-23 22:02:08,862 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 366702cb1a34f77a85567a0b5acb23df: 2023-09-23 22:02:08,864 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,864 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:02:08,864 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,864 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/cf/bbd71a22c3f94f1782a282074a508bf5] hfiles 2023-09-23 22:02:08,864 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 22:02:08,864 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/cf/bbd71a22c3f94f1782a282074a508bf5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,864 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/cf/24b3c8674bcb45618f0dfb8db2997572] hfiles 2023-09-23 22:02:08,864 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/cf/24b3c8674bcb45618f0dfb8db2997572 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,875 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. completed. 2023-09-23 22:02:08,875 DEBUG [rs(jenkins-hbase20.apache.org,38977,1695506434881)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:08,875 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:02:08,875 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. completed. 2023-09-23 22:02:08,875 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:02:08,875 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,875 DEBUG [rs(jenkins-hbase20.apache.org,44169,1695506434796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:08,875 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 22:02:08,875 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38977,1695506434881' in zk 2023-09-23 22:02:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 22:02:08,876 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:02:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,38977,1695506434881' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 22:02:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,878 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 22:02:08,878 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 22:02:08,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,878 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,878 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 22:02:08,878 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44169,1695506434796' in zk 2023-09-23 22:02:08,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,879 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,879 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 22:02:08,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,879 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:02:08,879 DEBUG [member: 'jenkins-hbase20.apache.org,44169,1695506434796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 22:02:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38977,1695506434881': 2023-09-23 22:02:08,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38977,1695506434881' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-23 22:02:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44169,1695506434796': 2023-09-23 22:02:08,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44169,1695506434796' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-23 22:02:08,886 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-23 22:02:08,886 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 22:02:08,886 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 22:02:08,886 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,886 INFO [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 22:02:08,893 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:02:08,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 22:02:08,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-23 22:02:08,894 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 22:02:08,894 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,894 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,894 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,894 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,894 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,894 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 22:02:08,895 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,895 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,895 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,896 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 22:02:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 22:02:08,897 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,897 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,897 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,902 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,903 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,903 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,903 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,903 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,903 DEBUG [(jenkins-hbase20.apache.org,36385,1695506433721)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 22:02:08,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,903 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 22:02:08,903 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 22:02:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,904 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 22:02:08,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,903 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 22:02:08,903 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,904 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,904 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,905 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:08,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 22:02:08,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 22:02:08,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 22:02:08,905 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,905 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:08,905 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:08,905 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,905 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092361d8ba1694514188a6334e1e6a361f11, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923d2c56a30bde8438fbee453a981a03d87] mob files 2023-09-23 22:02:08,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092361d8ba1694514188a6334e1e6a361f11 2023-09-23 22:02:08,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923d2c56a30bde8438fbee453a981a03d87 2023-09-23 22:02:08,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-23 22:02:08,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,931 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:08,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695506528790Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695506528913 (+123 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695506528913Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695506528913Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695506528916 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695506528923 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695506528930 (+7 ms) 2023-09-23 22:02:08,933 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 22:02:08,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 142 msec 2023-09-23 22:02:09,094 DEBUG [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 22:02:09,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 22:02:09,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 22:02:09,098 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098 2023-09-23 22:02:09,099 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45753, tgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098, rawTgtDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098, srcFsUri=hdfs://localhost:45753, srcDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:02:09,122 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523 2023-09-23 22:02:09,122 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1450115920_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:09,122 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45753, inputRoot=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523, snapshotDir=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-23 22:02:09,132 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:09,171 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,172 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,172 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,172 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,872 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-3268871972720796150.jar 2023-09-23 22:02:09,872 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,872 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,926 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/hadoop-3561985065933775494.jar 2023-09-23 22:02:09,926 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,926 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,927 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,927 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,927 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,928 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 22:02:09,928 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 22:02:09,928 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 22:02:09,928 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 22:02:09,929 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 22:02:09,929 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 22:02:09,929 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 22:02:09,930 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 22:02:09,930 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 22:02:09,930 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 22:02:09,931 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 22:02:09,931 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:02:09,931 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:02:09,932 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:02:09,932 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:02:09,932 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 22:02:09,932 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:02:09,933 DEBUG [Listener at jenkins-hbase20.apache.org/38553] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 22:02:10,255 WARN [Listener at jenkins-hbase20.apache.org/38553] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 22:02:10,257 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-23 22:02:10,259 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-23 22:02:12,133 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:02:12,133 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 22:02:12,135 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0006_000001 (auth:SIMPLE) 2023-09-23 22:02:12,675 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0007_000001 (auth:SIMPLE) 2023-09-23 22:02:13,033 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 22:02:15,967 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0007_000001 (auth:SIMPLE) 2023-09-23 22:02:18,161 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0007_000001 (auth:SIMPLE) 2023-09-23 22:02:20,901 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695506440948_0007_000001 (auth:SIMPLE) 2023-09-23 22:02:22,444 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 22:02:22,444 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 22:02:22,453 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,454 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 22:02:22,454 INFO [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 22:02:22,454 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-23 22:02:22,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-23 22:02:22,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_418675957_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-23 22:02:22,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] snapshot.TestExportSnapshot(367): hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/export-test/export-1695506529098/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-23 22:02:22,462 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 22:02:22,467 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506542467"}]},"ts":"1695506542467"} 2023-09-23 22:02:22,468 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-23 22:02:22,481 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-23 22:02:22,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4686b472db9bb652465aad2f6703e12f, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=366702cb1a34f77a85567a0b5acb23df, UNASSIGN}] 2023-09-23 22:02:22,483 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4686b472db9bb652465aad2f6703e12f, UNASSIGN 2023-09-23 22:02:22,484 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=366702cb1a34f77a85567a0b5acb23df, UNASSIGN 2023-09-23 22:02:22,485 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4686b472db9bb652465aad2f6703e12f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:22,485 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=366702cb1a34f77a85567a0b5acb23df, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:22,485 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506542485"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506542485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506542485"}]},"ts":"1695506542485"} 2023-09-23 22:02:22,485 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506542485"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695506542485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695506542485"}]},"ts":"1695506542485"} 2023-09-23 22:02:22,487 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 4686b472db9bb652465aad2f6703e12f, server=jenkins-hbase20.apache.org,44169,1695506434796}] 2023-09-23 22:02:22,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 366702cb1a34f77a85567a0b5acb23df, server=jenkins-hbase20.apache.org,38977,1695506434881}] 2023-09-23 22:02:22,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 22:02:22,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:22,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4686b472db9bb652465aad2f6703e12f, disabling compactions & flushes 2023-09-23 22:02:22,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:22,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:22,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. after waiting 0 ms 2023-09-23 22:02:22,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:22,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:22,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 366702cb1a34f77a85567a0b5acb23df, disabling compactions & flushes 2023-09-23 22:02:22,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:22,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:22,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. after waiting 0 ms 2023-09-23 22:02:22,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:22,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:02:22,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:02:22,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:22,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:22,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f. 2023-09-23 22:02:22,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4686b472db9bb652465aad2f6703e12f: 2023-09-23 22:02:22,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df. 2023-09-23 22:02:22,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 366702cb1a34f77a85567a0b5acb23df: 2023-09-23 22:02:22,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:22,662 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4686b472db9bb652465aad2f6703e12f, regionState=CLOSED 2023-09-23 22:02:22,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:22,662 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506542662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506542662"}]},"ts":"1695506542662"} 2023-09-23 22:02:22,662 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=366702cb1a34f77a85567a0b5acb23df, regionState=CLOSED 2023-09-23 22:02:22,663 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695506542662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695506542662"}]},"ts":"1695506542662"} 2023-09-23 22:02:22,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-23 22:02:22,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 4686b472db9bb652465aad2f6703e12f, server=jenkins-hbase20.apache.org,44169,1695506434796 in 176 msec 2023-09-23 22:02:22,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-23 22:02:22,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 366702cb1a34f77a85567a0b5acb23df, server=jenkins-hbase20.apache.org,38977,1695506434881 in 176 msec 2023-09-23 22:02:22,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4686b472db9bb652465aad2f6703e12f, UNASSIGN in 183 msec 2023-09-23 22:02:22,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-23 22:02:22,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=366702cb1a34f77a85567a0b5acb23df, UNASSIGN in 184 msec 2023-09-23 22:02:22,668 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695506542668"}]},"ts":"1695506542668"} 2023-09-23 22:02:22,669 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-23 22:02:22,670 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-23 22:02:22,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 209 msec 2023-09-23 22:02:22,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 22:02:22,770 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-23 22:02:22,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,778 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,780 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,783 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44169] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,785 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,785 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,785 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,785 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,785 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 22:02:22,785 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 22:02:22,785 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 22:02:22,785 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 22:02:22,786 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,786 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,786 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:22,786 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:22,786 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,786 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,786 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:22,786 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 22:02:22,786 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:22,786 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:22,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-23 22:02:22,788 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/recovered.edits] 2023-09-23 22:02:22,788 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/cf, FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/recovered.edits] 2023-09-23 22:02:22,791 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/cf/bbd71a22c3f94f1782a282074a508bf5 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/cf/bbd71a22c3f94f1782a282074a508bf5 2023-09-23 22:02:22,791 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/cf/24b3c8674bcb45618f0dfb8db2997572 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/cf/24b3c8674bcb45618f0dfb8db2997572 2023-09-23 22:02:22,793 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f/recovered.edits/9.seqid 2023-09-23 22:02:22,793 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/recovered.edits/9.seqid to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df/recovered.edits/9.seqid 2023-09-23 22:02:22,794 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4686b472db9bb652465aad2f6703e12f 2023-09-23 22:02:22,794 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/366702cb1a34f77a85567a0b5acb23df 2023-09-23 22:02:22,794 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-23 22:02:22,794 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-23 22:02:22,795 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-23 22:02:22,797 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092361d8ba1694514188a6334e1e6a361f11 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092361d8ba1694514188a6334e1e6a361f11 2023-09-23 22:02:22,798 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923d2c56a30bde8438fbee453a981a03d87 to hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230923d2c56a30bde8438fbee453a981a03d87 2023-09-23 22:02:22,799 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-23 22:02:22,800 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,802 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-23 22:02:22,803 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-23 22:02:22,804 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,804 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-23 22:02:22,804 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506542804"}]},"ts":"9223372036854775807"} 2023-09-23 22:02:22,805 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695506542804"}]},"ts":"9223372036854775807"} 2023-09-23 22:02:22,806 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 22:02:22,806 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4686b472db9bb652465aad2f6703e12f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695506527763.4686b472db9bb652465aad2f6703e12f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 366702cb1a34f77a85567a0b5acb23df, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695506527763.366702cb1a34f77a85567a0b5acb23df.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 22:02:22,806 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-23 22:02:22,806 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695506542806"}]},"ts":"9223372036854775807"} 2023-09-23 22:02:22,807 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-23 22:02:22,808 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 36 msec 2023-09-23 22:02:22,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-23 22:02:22,889 INFO [Listener at jenkins-hbase20.apache.org/38553] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-23 22:02:22,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-23 22:02:22,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-23 22:02:22,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 22:02:22,935 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 766), OpenFileDescriptor=923 (was 944), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=118 (was 142), ProcessCount=166 (was 166), AvailableMemoryMB=7010 (was 7112) 2023-09-23 22:02:22,935 WARN [Listener at jenkins-hbase20.apache.org/38553] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-23 22:02:22,935 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-23 22:02:22,947 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-23 22:02:23,066 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695506440948_0007_01_000001 is : 143 2023-09-23 22:02:28,225 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 22:02:37,085 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-23 22:02:51,216 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 22:02:51,217 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-23 22:02:51,328 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-23 22:02:51,336 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-23 22:02:51,338 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 22:02:51,348 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-23 22:02:51,453 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 22:02:51,453 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-23 22:02:51,453 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-23 22:02:51,454 INFO [Listener at jenkins-hbase20.apache.org/38553] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-23 22:02:51,454 DEBUG [Listener at jenkins-hbase20.apache.org/38553] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e62b284 to 127.0.0.1:58910 2023-09-23 22:02:51,454 DEBUG [Listener at jenkins-hbase20.apache.org/38553] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:51,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-23 22:02:51,455 DEBUG [Listener at jenkins-hbase20.apache.org/38553] util.JVMClusterUtil(257): Found active master hash=1749259099, stopped=false 2023-09-23 22:02:51,456 DEBUG [Listener at jenkins-hbase20.apache.org/38553] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:51,456 DEBUG [Listener at jenkins-hbase20.apache.org/38553] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-23 22:02:51,456 INFO [Listener at jenkins-hbase20.apache.org/38553] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:02:51,458 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 22:02:51,458 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 22:02:51,458 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 22:02:51,458 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 22:02:51,458 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:02:51,458 INFO [Listener at jenkins-hbase20.apache.org/38553] procedure2.ProcedureExecutor(628): Stopping 2023-09-23 22:02:51,459 DEBUG [Listener at jenkins-hbase20.apache.org/38553] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67d0e7ff to 127.0.0.1:58910 2023-09-23 22:02:51,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 22:02:51,459 DEBUG [Listener at jenkins-hbase20.apache.org/38553] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:51,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 22:02:51,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 22:02:51,459 INFO [Listener at jenkins-hbase20.apache.org/38553] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44169,1695506434796' ***** 2023-09-23 22:02:51,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 22:02:51,460 DEBUG [Listener at jenkins-hbase20.apache.org/38553] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:51,460 INFO [Listener at jenkins-hbase20.apache.org/38553] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 22:02:51,460 INFO [Listener at jenkins-hbase20.apache.org/38553] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,45419,1695506434840' ***** 2023-09-23 22:02:51,461 DEBUG [Listener at jenkins-hbase20.apache.org/38553] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:51,461 INFO [Listener at jenkins-hbase20.apache.org/38553] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 22:02:51,461 INFO [Listener at jenkins-hbase20.apache.org/38553] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38977,1695506434881' ***** 2023-09-23 22:02:51,461 INFO [RS:0;jenkins-hbase20:44169] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 22:02:51,461 DEBUG [Listener at jenkins-hbase20.apache.org/38553] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:51,461 INFO [RS:1;jenkins-hbase20:45419] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 22:02:51,461 INFO [Listener at jenkins-hbase20.apache.org/38553] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 22:02:51,461 INFO [RS:1;jenkins-hbase20:45419] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 22:02:51,461 INFO [RS:2;jenkins-hbase20:38977] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 22:02:51,461 INFO [RS:1;jenkins-hbase20:45419] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 22:02:51,461 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(3305): Received CLOSE for 62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:02:51,462 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:51,462 DEBUG [RS:1;jenkins-hbase20:45419] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d193553 to 127.0.0.1:58910 2023-09-23 22:02:51,462 DEBUG [RS:1;jenkins-hbase20:45419] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:51,461 INFO [RS:0;jenkins-hbase20:44169] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 22:02:51,464 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-23 22:02:51,464 INFO [RS:0;jenkins-hbase20:44169] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 22:02:51,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 62ae6d0ab3b18432a12965c3191ff10f, disabling compactions & flushes 2023-09-23 22:02:51,461 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 22:02:51,461 INFO [RS:2;jenkins-hbase20:38977] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 22:02:51,464 INFO [RS:2;jenkins-hbase20:38977] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 22:02:51,461 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 22:02:51,461 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 22:02:51,464 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:51,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:02:51,464 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(3305): Received CLOSE for 6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:02:51,464 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1478): Online Regions={62ae6d0ab3b18432a12965c3191ff10f=hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f.} 2023-09-23 22:02:51,464 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:51,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:02:51,464 DEBUG [RS:2;jenkins-hbase20:38977] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77c8214c to 127.0.0.1:58910 2023-09-23 22:02:51,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6d9d3cf10b4fdbd9698928da6b7ddacb, disabling compactions & flushes 2023-09-23 22:02:51,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. after waiting 0 ms 2023-09-23 22:02:51,464 DEBUG [RS:0;jenkins-hbase20:44169] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74157c6c to 127.0.0.1:58910 2023-09-23 22:02:51,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:02:51,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:02:51,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 62ae6d0ab3b18432a12965c3191ff10f 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-23 22:02:51,465 DEBUG [RS:2;jenkins-hbase20:38977] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:51,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:02:51,466 INFO [RS:2;jenkins-hbase20:38977] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 22:02:51,465 DEBUG [RS:0;jenkins-hbase20:44169] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:51,466 INFO [RS:2;jenkins-hbase20:38977] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 22:02:51,466 INFO [RS:2;jenkins-hbase20:38977] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 22:02:51,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. after waiting 0 ms 2023-09-23 22:02:51,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:02:51,466 DEBUG [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1504): Waiting on 62ae6d0ab3b18432a12965c3191ff10f 2023-09-23 22:02:51,467 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-23 22:02:51,466 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-23 22:02:51,467 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1478): Online Regions={6d9d3cf10b4fdbd9698928da6b7ddacb=hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb.} 2023-09-23 22:02:51,467 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 22:02:51,467 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-23 22:02:51,467 DEBUG [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1504): Waiting on 6d9d3cf10b4fdbd9698928da6b7ddacb 2023-09-23 22:02:51,467 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-23 22:02:51,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 6d9d3cf10b4fdbd9698928da6b7ddacb 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-23 22:02:51,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-23 22:02:51,468 DEBUG [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-23 22:02:51,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-23 22:02:51,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-23 22:02:51,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-23 22:02:51,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-23 22:02:51,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-09-23 22:02:51,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f/.tmp/info/d852b67041fe4053bca85e2b5b380ba7 2023-09-23 22:02:51,493 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/.tmp/info/18604ca7fb674af2a89598b7afdbf0b6 2023-09-23 22:02:51,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb/.tmp/l/9a833241543a459c8e39d3459d914276 2023-09-23 22:02:51,498 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18604ca7fb674af2a89598b7afdbf0b6 2023-09-23 22:02:51,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f/.tmp/info/d852b67041fe4053bca85e2b5b380ba7 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f/info/d852b67041fe4053bca85e2b5b380ba7 2023-09-23 22:02:51,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a833241543a459c8e39d3459d914276 2023-09-23 22:02:51,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb/.tmp/l/9a833241543a459c8e39d3459d914276 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb/l/9a833241543a459c8e39d3459d914276 2023-09-23 22:02:51,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f/info/d852b67041fe4053bca85e2b5b380ba7, entries=2, sequenceid=6, filesize=4.8 K 2023-09-23 22:02:51,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 62ae6d0ab3b18432a12965c3191ff10f in 40ms, sequenceid=6, compaction requested=false 2023-09-23 22:02:51,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a833241543a459c8e39d3459d914276 2023-09-23 22:02:51,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb/l/9a833241543a459c8e39d3459d914276, entries=7, sequenceid=18, filesize=5.2 K 2023-09-23 22:02:51,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 6d9d3cf10b4fdbd9698928da6b7ddacb in 43ms, sequenceid=18, compaction requested=false 2023-09-23 22:02:51,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/namespace/62ae6d0ab3b18432a12965c3191ff10f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 22:02:51,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:51,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:02:51,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 62ae6d0ab3b18432a12965c3191ff10f: 2023-09-23 22:02:51,514 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/.tmp/rep_barrier/4be5bd49df0e49e8bdbebee011bf8fc6 2023-09-23 22:02:51,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695506436808.62ae6d0ab3b18432a12965c3191ff10f. 2023-09-23 22:02:51,521 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4be5bd49df0e49e8bdbebee011bf8fc6 2023-09-23 22:02:51,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/acl/6d9d3cf10b4fdbd9698928da6b7ddacb/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-23 22:02:51,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:51,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:02:51,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6d9d3cf10b4fdbd9698928da6b7ddacb: 2023-09-23 22:02:51,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695506437573.6d9d3cf10b4fdbd9698928da6b7ddacb. 2023-09-23 22:02:51,534 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/.tmp/table/f7d6f4c0c3ba49f38190b77afdd6c1b9 2023-09-23 22:02:51,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7d6f4c0c3ba49f38190b77afdd6c1b9 2023-09-23 22:02:51,538 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/.tmp/info/18604ca7fb674af2a89598b7afdbf0b6 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/info/18604ca7fb674af2a89598b7afdbf0b6 2023-09-23 22:02:51,543 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18604ca7fb674af2a89598b7afdbf0b6 2023-09-23 22:02:51,543 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/info/18604ca7fb674af2a89598b7afdbf0b6, entries=48, sequenceid=131, filesize=10.3 K 2023-09-23 22:02:51,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/.tmp/rep_barrier/4be5bd49df0e49e8bdbebee011bf8fc6 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/rep_barrier/4be5bd49df0e49e8bdbebee011bf8fc6 2023-09-23 22:02:51,546 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 22:02:51,546 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 22:02:51,549 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4be5bd49df0e49e8bdbebee011bf8fc6 2023-09-23 22:02:51,549 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/rep_barrier/4be5bd49df0e49e8bdbebee011bf8fc6, entries=13, sequenceid=131, filesize=6.4 K 2023-09-23 22:02:51,550 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/.tmp/table/f7d6f4c0c3ba49f38190b77afdd6c1b9 as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/table/f7d6f4c0c3ba49f38190b77afdd6c1b9 2023-09-23 22:02:51,555 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7d6f4c0c3ba49f38190b77afdd6c1b9 2023-09-23 22:02:51,555 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/table/f7d6f4c0c3ba49f38190b77afdd6c1b9, entries=24, sequenceid=131, filesize=6.9 K 2023-09-23 22:02:51,556 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 88ms, sequenceid=131, compaction requested=false 2023-09-23 22:02:51,569 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-23 22:02:51,569 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 22:02:51,569 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-23 22:02:51,570 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-23 22:02:51,570 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-23 22:02:51,570 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-23 22:02:51,667 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,45419,1695506434840; all regions closed. 2023-09-23 22:02:51,667 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44169,1695506434796; all regions closed. 2023-09-23 22:02:51,668 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38977,1695506434881; all regions closed. 2023-09-23 22:02:51,677 DEBUG [RS:1;jenkins-hbase20:45419] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/oldWALs 2023-09-23 22:02:51,677 DEBUG [RS:0;jenkins-hbase20:44169] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/oldWALs 2023-09-23 22:02:51,677 INFO [RS:1;jenkins-hbase20:45419] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C45419%2C1695506434840:(num 1695506436387) 2023-09-23 22:02:51,677 DEBUG [RS:2;jenkins-hbase20:38977] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/oldWALs 2023-09-23 22:02:51,677 INFO [RS:0;jenkins-hbase20:44169] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44169%2C1695506434796:(num 1695506436387) 2023-09-23 22:02:51,678 DEBUG [RS:0;jenkins-hbase20:44169] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:51,678 INFO [RS:2;jenkins-hbase20:38977] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38977%2C1695506434881.meta:.meta(num 1695506436524) 2023-09-23 22:02:51,677 DEBUG [RS:1;jenkins-hbase20:45419] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:51,678 INFO [RS:0;jenkins-hbase20:44169] regionserver.LeaseManager(133): Closed leases 2023-09-23 22:02:51,678 INFO [RS:1;jenkins-hbase20:45419] regionserver.LeaseManager(133): Closed leases 2023-09-23 22:02:51,678 INFO [RS:1;jenkins-hbase20:45419] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-23 22:02:51,678 INFO [RS:0;jenkins-hbase20:44169] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-23 22:02:51,678 INFO [RS:1;jenkins-hbase20:45419] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 22:02:51,679 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 22:02:51,679 INFO [RS:1;jenkins-hbase20:45419] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 22:02:51,679 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 22:02:51,679 INFO [RS:0;jenkins-hbase20:44169] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 22:02:51,679 INFO [RS:0;jenkins-hbase20:44169] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 22:02:51,679 INFO [RS:0;jenkins-hbase20:44169] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 22:02:51,679 INFO [RS:1;jenkins-hbase20:45419] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 22:02:51,681 INFO [RS:0;jenkins-hbase20:44169] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44169 2023-09-23 22:02:51,681 INFO [RS:1;jenkins-hbase20:45419] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:45419 2023-09-23 22:02:51,684 DEBUG [RS:2;jenkins-hbase20:38977] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/oldWALs 2023-09-23 22:02:51,684 INFO [RS:2;jenkins-hbase20:38977] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38977%2C1695506434881:(num 1695506436387) 2023-09-23 22:02:51,684 DEBUG [RS:2;jenkins-hbase20:38977] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:51,684 INFO [RS:2;jenkins-hbase20:38977] regionserver.LeaseManager(133): Closed leases 2023-09-23 22:02:51,685 INFO [RS:2;jenkins-hbase20:38977] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-23 22:02:51,685 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 22:02:51,685 INFO [RS:2;jenkins-hbase20:38977] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38977 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38977,1695506434881 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44169,1695506434796 2023-09-23 22:02:51,687 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,45419,1695506434840 2023-09-23 22:02:51,688 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,45419,1695506434840] 2023-09-23 22:02:51,688 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,45419,1695506434840; numProcessing=1 2023-09-23 22:02:51,689 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,45419,1695506434840 already deleted, retry=false 2023-09-23 22:02:51,689 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,45419,1695506434840 expired; onlineServers=2 2023-09-23 22:02:51,689 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38977,1695506434881] 2023-09-23 22:02:51,689 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38977,1695506434881; numProcessing=2 2023-09-23 22:02:51,689 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38977,1695506434881 already deleted, retry=false 2023-09-23 22:02:51,689 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38977,1695506434881 expired; onlineServers=1 2023-09-23 22:02:51,689 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44169,1695506434796] 2023-09-23 22:02:51,689 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44169,1695506434796; numProcessing=3 2023-09-23 22:02:51,690 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44169,1695506434796 already deleted, retry=false 2023-09-23 22:02:51,690 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44169,1695506434796 expired; onlineServers=0 2023-09-23 22:02:51,690 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,36385,1695506433721' ***** 2023-09-23 22:02:51,690 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-23 22:02:51,690 DEBUG [M:0;jenkins-hbase20:36385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@297e9960, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-23 22:02:51,690 INFO [M:0;jenkins-hbase20:36385] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,36385,1695506433721 2023-09-23 22:02:51,690 INFO [M:0;jenkins-hbase20:36385] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,36385,1695506433721; all regions closed. 2023-09-23 22:02:51,690 DEBUG [M:0;jenkins-hbase20:36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 22:02:51,690 DEBUG [M:0;jenkins-hbase20:36385] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-23 22:02:51,690 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-23 22:02:51,691 DEBUG [M:0;jenkins-hbase20:36385] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-23 22:02:51,691 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1695506436018] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1695506436018,5,FailOnTimeoutGroup] 2023-09-23 22:02:51,691 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1695506436018] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1695506436018,5,FailOnTimeoutGroup] 2023-09-23 22:02:51,691 INFO [M:0;jenkins-hbase20:36385] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-23 22:02:51,691 INFO [M:0;jenkins-hbase20:36385] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-23 22:02:51,691 INFO [M:0;jenkins-hbase20:36385] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-09-23 22:02:51,691 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-23 22:02:51,691 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 22:02:51,691 DEBUG [M:0;jenkins-hbase20:36385] master.HMaster(1512): Stopping service threads 2023-09-23 22:02:51,691 INFO [M:0;jenkins-hbase20:36385] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-23 22:02:51,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 22:02:51,691 ERROR [M:0;jenkins-hbase20:36385] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-23 22:02:51,692 INFO [M:0;jenkins-hbase20:36385] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-23 22:02:51,692 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-23 22:02:51,692 DEBUG [M:0;jenkins-hbase20:36385] zookeeper.ZKUtil(398): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-23 22:02:51,692 WARN [M:0;jenkins-hbase20:36385] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-23 22:02:51,692 INFO [M:0;jenkins-hbase20:36385] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-23 22:02:51,692 INFO [M:0;jenkins-hbase20:36385] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-23 22:02:51,693 DEBUG [M:0;jenkins-hbase20:36385] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-23 22:02:51,693 INFO [M:0;jenkins-hbase20:36385] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 22:02:51,693 DEBUG [M:0;jenkins-hbase20:36385] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 22:02:51,693 DEBUG [M:0;jenkins-hbase20:36385] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-23 22:02:51,693 DEBUG [M:0;jenkins-hbase20:36385] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 22:02:51,693 INFO [M:0;jenkins-hbase20:36385] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.09 KB heapSize=452.34 KB 2023-09-23 22:02:51,705 INFO [M:0;jenkins-hbase20:36385] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.09 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7575cce70f504f77b1afcc2506039d5e 2023-09-23 22:02:51,708 INFO [M:0;jenkins-hbase20:36385] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7575cce70f504f77b1afcc2506039d5e 2023-09-23 22:02:51,709 DEBUG [M:0;jenkins-hbase20:36385] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7575cce70f504f77b1afcc2506039d5e as hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7575cce70f504f77b1afcc2506039d5e 2023-09-23 22:02:51,713 INFO [M:0;jenkins-hbase20:36385] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7575cce70f504f77b1afcc2506039d5e 2023-09-23 22:02:51,713 INFO [M:0;jenkins-hbase20:36385] regionserver.HStore(1080): Added hdfs://localhost:45753/user/jenkins/test-data/5128eb36-fc87-5c3b-99c3-4f5fc5c78523/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7575cce70f504f77b1afcc2506039d5e, entries=119, sequenceid=899, filesize=28.6 K 2023-09-23 22:02:51,713 INFO [M:0;jenkins-hbase20:36385] regionserver.HRegion(2948): Finished flush of dataSize ~376.09 KB/385114, heapSize ~452.32 KB/463176, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=899, compaction requested=false 2023-09-23 22:02:51,715 INFO [M:0;jenkins-hbase20:36385] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 22:02:51,715 DEBUG [M:0;jenkins-hbase20:36385] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 22:02:51,717 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 22:02:51,717 INFO [M:0;jenkins-hbase20:36385] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-23 22:02:51,718 INFO [M:0;jenkins-hbase20:36385] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36385 2023-09-23 22:02:51,719 DEBUG [M:0;jenkins-hbase20:36385] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,36385,1695506433721 already deleted, retry=false 2023-09-23 22:02:51,788 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 22:02:51,788 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:38977-0x100c651d42a0003, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 22:02:51,788 INFO [RS:2;jenkins-hbase20:38977] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38977,1695506434881; zookeeper connection closed. 2023-09-23 22:02:51,789 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d958595] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d958595 2023-09-23 22:02:51,888 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 22:02:51,888 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): master:36385-0x100c651d42a0000, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 22:02:51,888 INFO [M:0;jenkins-hbase20:36385] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,36385,1695506433721; zookeeper connection closed. 2023-09-23 22:02:51,989 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 22:02:51,989 INFO [RS:1;jenkins-hbase20:45419] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,45419,1695506434840; zookeeper connection closed. 2023-09-23 22:02:51,989 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:45419-0x100c651d42a0002, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 22:02:51,989 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7ee23fda] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7ee23fda 2023-09-23 22:02:52,089 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 22:02:52,089 DEBUG [Listener at localhost/33939-EventThread] zookeeper.ZKWatcher(600): regionserver:44169-0x100c651d42a0001, quorum=127.0.0.1:58910, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 22:02:52,089 INFO [RS:0;jenkins-hbase20:44169] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44169,1695506434796; zookeeper connection closed. 2023-09-23 22:02:52,090 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@215ab592] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@215ab592 2023-09-23 22:02:52,091 INFO [Listener at jenkins-hbase20.apache.org/38553] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-23 22:02:52,092 WARN [Listener at jenkins-hbase20.apache.org/38553] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 22:02:52,099 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 22:02:52,204 WARN [BP-82128332-148.251.75.209-1695506430310 heartbeating to localhost/127.0.0.1:45753] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 22:02:52,204 WARN [BP-82128332-148.251.75.209-1695506430310 heartbeating to localhost/127.0.0.1:45753] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-82128332-148.251.75.209-1695506430310 (Datanode Uuid 6bd27096-b0aa-4baa-8c79-92b097c16617) service to localhost/127.0.0.1:45753 2023-09-23 22:02:52,208 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data5/current/BP-82128332-148.251.75.209-1695506430310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 22:02:52,209 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data6/current/BP-82128332-148.251.75.209-1695506430310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 22:02:52,211 WARN [Listener at jenkins-hbase20.apache.org/38553] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 22:02:52,213 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 22:02:52,320 WARN [BP-82128332-148.251.75.209-1695506430310 heartbeating to localhost/127.0.0.1:45753] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 22:02:52,320 WARN [BP-82128332-148.251.75.209-1695506430310 heartbeating to localhost/127.0.0.1:45753] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-82128332-148.251.75.209-1695506430310 (Datanode Uuid dba406f0-ea64-4692-9dc8-34a989ed6e72) service to localhost/127.0.0.1:45753 2023-09-23 22:02:52,321 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data3/current/BP-82128332-148.251.75.209-1695506430310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 22:02:52,321 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data4/current/BP-82128332-148.251.75.209-1695506430310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 22:02:52,322 WARN [Listener at jenkins-hbase20.apache.org/38553] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 22:02:52,324 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 22:02:52,430 WARN [BP-82128332-148.251.75.209-1695506430310 heartbeating to localhost/127.0.0.1:45753] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 22:02:52,430 WARN [BP-82128332-148.251.75.209-1695506430310 heartbeating to localhost/127.0.0.1:45753] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-82128332-148.251.75.209-1695506430310 (Datanode Uuid e41143fc-b293-4e05-9443-dd360d9e7a4c) service to localhost/127.0.0.1:45753 2023-09-23 22:02:52,432 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data1/current/BP-82128332-148.251.75.209-1695506430310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 22:02:52,433 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ca96605d-7524-e9cf-443d-9bd3e87bde05/cluster_be587c8e-be16-a019-7d49-62567f02ec43/dfs/data/data2/current/BP-82128332-148.251.75.209-1695506430310] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 22:02:52,459 INFO [Listener at jenkins-hbase20.apache.org/38553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 22:02:52,588 INFO [Listener at jenkins-hbase20.apache.org/38553] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-23 22:02:52,673 INFO [Listener at jenkins-hbase20.apache.org/38553] hbase.HBaseTestingUtility(1293): Minicluster is down