2023-07-19 19:10:28,244 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 19:10:28,491 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab 2023-07-19 19:10:28,491 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-19 19:10:28,541 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 19:10:28,827 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 19:10:28,828 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e, deleteOnExit=true 2023-07-19 19:10:28,828 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 19:10:28,829 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/test.cache.data in system properties and HBase conf 2023-07-19 19:10:28,829 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 19:10:28,830 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop.log.dir in system properties and HBase conf 2023-07-19 19:10:28,830 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 19:10:28,831 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 19:10:28,831 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 19:10:29,214 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 19:10:29,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 19:10:29,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 19:10:29,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 19:10:29,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 19:10:29,221 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 19:10:29,221 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 19:10:29,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 19:10:29,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 19:10:29,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 19:10:29,223 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/nfs.dump.dir in system properties and HBase conf 2023-07-19 19:10:29,223 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir in system properties and HBase conf 2023-07-19 19:10:29,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 19:10:29,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 19:10:29,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 19:10:29,815 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 19:10:29,820 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 19:10:30,095 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 19:10:30,263 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 19:10:30,283 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:30,330 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:30,378 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir/Jetty_localhost_44711_hdfs____p0l1vl/webapp 2023-07-19 19:10:30,542 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44711 2023-07-19 19:10:30,588 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 19:10:30,588 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 19:10:31,116 WARN [Listener at localhost/39651] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 19:10:31,218 WARN [Listener at localhost/39651] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 19:10:31,241 WARN [Listener at localhost/39651] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:31,250 INFO [Listener at localhost/39651] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:31,258 INFO [Listener at localhost/39651] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir/Jetty_localhost_42095_datanode____.w864uj/webapp 2023-07-19 19:10:31,397 INFO [Listener at localhost/39651] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42095 2023-07-19 19:10:31,952 WARN [Listener at localhost/42521] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 19:10:31,984 WARN [Listener at localhost/42521] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 19:10:31,993 WARN [Listener at localhost/42521] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:31,995 INFO [Listener at localhost/42521] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:32,002 INFO [Listener at localhost/42521] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir/Jetty_localhost_33453_datanode____8sm89l/webapp 2023-07-19 19:10:32,127 INFO [Listener at localhost/42521] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33453 2023-07-19 19:10:32,154 WARN [Listener at localhost/38021] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 19:10:32,197 WARN [Listener at localhost/38021] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 19:10:32,201 WARN [Listener at localhost/38021] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:32,203 INFO [Listener at localhost/38021] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:32,211 INFO [Listener at localhost/38021] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir/Jetty_localhost_39573_datanode____.xnkkj2/webapp 2023-07-19 19:10:32,395 INFO [Listener at localhost/38021] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39573 2023-07-19 19:10:32,430 WARN [Listener at localhost/40019] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 19:10:32,726 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa37087faede2ea74: Processing first storage report for DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba from datanode 58694873-425c-4962-ad55-d50fca77907d 2023-07-19 19:10:32,727 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa37087faede2ea74: from storage DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba node DatanodeRegistration(127.0.0.1:44549, datanodeUuid=58694873-425c-4962-ad55-d50fca77907d, infoPort=43849, infoSecurePort=0, ipcPort=40019, storageInfo=lv=-57;cid=testClusterID;nsid=394895821;c=1689793829890), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,728 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x20ddfc6a3836988: Processing first storage report for DS-46ab7883-ba73-4565-92e3-40c0986912a1 from datanode 1e243d81-5594-4f84-aeb3-0793ec2c6f92 2023-07-19 19:10:32,728 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x20ddfc6a3836988: from storage DS-46ab7883-ba73-4565-92e3-40c0986912a1 node DatanodeRegistration(127.0.0.1:39611, datanodeUuid=1e243d81-5594-4f84-aeb3-0793ec2c6f92, infoPort=46513, infoSecurePort=0, ipcPort=42521, storageInfo=lv=-57;cid=testClusterID;nsid=394895821;c=1689793829890), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,728 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77e2b40b904f3527: Processing first storage report for DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57 from datanode ea9afea5-8c2f-4e9e-999f-876ec8efc119 2023-07-19 19:10:32,728 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77e2b40b904f3527: from storage DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57 node DatanodeRegistration(127.0.0.1:37561, datanodeUuid=ea9afea5-8c2f-4e9e-999f-876ec8efc119, infoPort=36175, infoSecurePort=0, ipcPort=38021, storageInfo=lv=-57;cid=testClusterID;nsid=394895821;c=1689793829890), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,729 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa37087faede2ea74: Processing first storage report for DS-06f47313-9740-4457-bf97-94bbaec9d25b from datanode 58694873-425c-4962-ad55-d50fca77907d 2023-07-19 19:10:32,729 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa37087faede2ea74: from storage DS-06f47313-9740-4457-bf97-94bbaec9d25b node DatanodeRegistration(127.0.0.1:44549, datanodeUuid=58694873-425c-4962-ad55-d50fca77907d, infoPort=43849, infoSecurePort=0, ipcPort=40019, storageInfo=lv=-57;cid=testClusterID;nsid=394895821;c=1689793829890), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,729 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x20ddfc6a3836988: Processing first storage report for DS-9f372461-6a37-4b86-b825-8534b2c81ddf from datanode 1e243d81-5594-4f84-aeb3-0793ec2c6f92 2023-07-19 19:10:32,729 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x20ddfc6a3836988: from storage DS-9f372461-6a37-4b86-b825-8534b2c81ddf node DatanodeRegistration(127.0.0.1:39611, datanodeUuid=1e243d81-5594-4f84-aeb3-0793ec2c6f92, infoPort=46513, infoSecurePort=0, ipcPort=42521, storageInfo=lv=-57;cid=testClusterID;nsid=394895821;c=1689793829890), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,729 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77e2b40b904f3527: Processing first storage report for DS-c9e73e18-8a3d-459c-bfd0-45fffc6c408d from datanode ea9afea5-8c2f-4e9e-999f-876ec8efc119 2023-07-19 19:10:32,729 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77e2b40b904f3527: from storage DS-c9e73e18-8a3d-459c-bfd0-45fffc6c408d node DatanodeRegistration(127.0.0.1:37561, datanodeUuid=ea9afea5-8c2f-4e9e-999f-876ec8efc119, infoPort=36175, infoSecurePort=0, ipcPort=38021, storageInfo=lv=-57;cid=testClusterID;nsid=394895821;c=1689793829890), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,972 DEBUG [Listener at localhost/40019] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab 2023-07-19 19:10:33,056 INFO [Listener at localhost/40019] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/zookeeper_0, clientPort=50021, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 19:10:33,079 INFO [Listener at localhost/40019] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50021 2023-07-19 19:10:33,094 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:33,097 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:33,834 INFO [Listener at localhost/40019] util.FSUtils(471): Created version file at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 with version=8 2023-07-19 19:10:33,835 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/hbase-staging 2023-07-19 19:10:34,212 INFO [Listener at localhost/40019] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 19:10:34,847 INFO [Listener at localhost/40019] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 19:10:34,881 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:34,881 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:34,881 INFO [Listener at localhost/40019] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 19:10:34,882 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:34,882 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 19:10:35,049 INFO [Listener at localhost/40019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 19:10:35,129 DEBUG [Listener at localhost/40019] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 19:10:35,262 INFO [Listener at localhost/40019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43163 2023-07-19 19:10:35,277 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,279 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,308 INFO [Listener at localhost/40019] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43163 connecting to ZooKeeper ensemble=127.0.0.1:50021 2023-07-19 19:10:35,365 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:431630x0, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 19:10:35,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43163-0x1017efe2b4a0000 connected 2023-07-19 19:10:35,416 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:10:35,417 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:10:35,431 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 19:10:35,440 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43163 2023-07-19 19:10:35,441 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43163 2023-07-19 19:10:35,441 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43163 2023-07-19 19:10:35,442 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43163 2023-07-19 19:10:35,443 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43163 2023-07-19 19:10:35,450 INFO [Listener at localhost/40019] master.HMaster(444): hbase.rootdir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7, hbase.cluster.distributed=false 2023-07-19 19:10:35,516 INFO [Listener at localhost/40019] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 19:10:35,517 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,517 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,517 INFO [Listener at localhost/40019] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 19:10:35,517 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,517 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 19:10:35,522 INFO [Listener at localhost/40019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 19:10:35,527 INFO [Listener at localhost/40019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37775 2023-07-19 19:10:35,530 INFO [Listener at localhost/40019] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 19:10:35,538 DEBUG [Listener at localhost/40019] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 19:10:35,540 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,542 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,544 INFO [Listener at localhost/40019] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37775 connecting to ZooKeeper ensemble=127.0.0.1:50021 2023-07-19 19:10:35,550 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:377750x0, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 19:10:35,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37775-0x1017efe2b4a0001 connected 2023-07-19 19:10:35,551 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:10:35,553 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:10:35,554 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 19:10:35,558 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37775 2023-07-19 19:10:35,559 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37775 2023-07-19 19:10:35,559 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37775 2023-07-19 19:10:35,562 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37775 2023-07-19 19:10:35,562 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37775 2023-07-19 19:10:35,575 INFO [Listener at localhost/40019] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 19:10:35,576 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,576 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,577 INFO [Listener at localhost/40019] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 19:10:35,577 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,577 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 19:10:35,577 INFO [Listener at localhost/40019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 19:10:35,583 INFO [Listener at localhost/40019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39881 2023-07-19 19:10:35,584 INFO [Listener at localhost/40019] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 19:10:35,586 DEBUG [Listener at localhost/40019] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 19:10:35,587 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,589 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,592 INFO [Listener at localhost/40019] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39881 connecting to ZooKeeper ensemble=127.0.0.1:50021 2023-07-19 19:10:35,601 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:398810x0, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 19:10:35,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39881-0x1017efe2b4a0002 connected 2023-07-19 19:10:35,603 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:10:35,604 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:10:35,605 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 19:10:35,606 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39881 2023-07-19 19:10:35,610 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39881 2023-07-19 19:10:35,613 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39881 2023-07-19 19:10:35,614 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39881 2023-07-19 19:10:35,616 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39881 2023-07-19 19:10:35,631 INFO [Listener at localhost/40019] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 19:10:35,631 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,631 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,631 INFO [Listener at localhost/40019] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 19:10:35,632 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,632 INFO [Listener at localhost/40019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 19:10:35,632 INFO [Listener at localhost/40019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 19:10:35,634 INFO [Listener at localhost/40019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39767 2023-07-19 19:10:35,634 INFO [Listener at localhost/40019] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 19:10:35,635 DEBUG [Listener at localhost/40019] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 19:10:35,637 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,639 INFO [Listener at localhost/40019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,640 INFO [Listener at localhost/40019] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39767 connecting to ZooKeeper ensemble=127.0.0.1:50021 2023-07-19 19:10:35,647 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:397670x0, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 19:10:35,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39767-0x1017efe2b4a0003 connected 2023-07-19 19:10:35,648 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:10:35,648 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:10:35,649 DEBUG [Listener at localhost/40019] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 19:10:35,653 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39767 2023-07-19 19:10:35,655 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39767 2023-07-19 19:10:35,659 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39767 2023-07-19 19:10:35,664 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39767 2023-07-19 19:10:35,665 DEBUG [Listener at localhost/40019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39767 2023-07-19 19:10:35,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:10:35,691 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 19:10:35,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:10:35,719 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 19:10:35,719 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 19:10:35,719 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 19:10:35,720 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:35,720 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 19:10:35,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 19:10:35,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 19:10:35,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43163,1689793834027 from backup master directory 2023-07-19 19:10:35,729 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:10:35,730 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 19:10:35,731 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 19:10:35,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:10:35,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 19:10:35,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 19:10:35,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/hbase.id with ID: b6eb8607-1897-4081-a48b-b6829e57d2c5 2023-07-19 19:10:35,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,937 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:36,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2cdbbc26 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:36,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fc8ccf2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:36,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:10:36,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 19:10:36,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 19:10:36,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 19:10:36,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 19:10:36,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 19:10:36,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:36,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/data/master/store-tmp 2023-07-19 19:10:36,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:36,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 19:10:36,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:10:36,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:10:36,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 19:10:36,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:10:36,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:10:36,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 19:10:36,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/WALs/jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:10:36,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43163%2C1689793834027, suffix=, logDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/WALs/jenkins-hbase4.apache.org,43163,1689793834027, archiveDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/oldWALs, maxLogs=10 2023-07-19 19:10:36,361 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK] 2023-07-19 19:10:36,367 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK] 2023-07-19 19:10:36,367 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK] 2023-07-19 19:10:36,376 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 19:10:36,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/WALs/jenkins-hbase4.apache.org,43163,1689793834027/jenkins-hbase4.apache.org%2C43163%2C1689793834027.1689793836291 2023-07-19 19:10:36,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK], DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK], DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK]] 2023-07-19 19:10:36,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:10:36,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:36,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,557 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,565 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 19:10:36,607 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 19:10:36,622 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:36,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:36,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66526010, jitterRate=-0.008685201406478882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:36,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 19:10:36,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 19:10:36,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 19:10:36,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 19:10:36,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 19:10:36,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 19:10:36,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 45 msec 2023-07-19 19:10:36,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 19:10:36,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 19:10:36,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 19:10:36,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 19:10:36,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 19:10:36,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 19:10:36,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 19:10:36,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 19:10:36,855 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:36,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 19:10:36,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 19:10:36,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 19:10:36,889 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 19:10:36,889 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 19:10:36,889 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 19:10:36,889 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:36,889 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 19:10:36,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43163,1689793834027, sessionid=0x1017efe2b4a0000, setting cluster-up flag (Was=false) 2023-07-19 19:10:36,917 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:36,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 19:10:36,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:10:36,931 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:36,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 19:10:36,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:10:36,943 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp 2023-07-19 19:10:36,978 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(951): ClusterId : b6eb8607-1897-4081-a48b-b6829e57d2c5 2023-07-19 19:10:36,978 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(951): ClusterId : b6eb8607-1897-4081-a48b-b6829e57d2c5 2023-07-19 19:10:36,991 DEBUG [RS:0;jenkins-hbase4:37775] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 19:10:36,991 DEBUG [RS:1;jenkins-hbase4:39881] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 19:10:36,992 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(951): ClusterId : b6eb8607-1897-4081-a48b-b6829e57d2c5 2023-07-19 19:10:36,993 DEBUG [RS:2;jenkins-hbase4:39767] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 19:10:37,001 DEBUG [RS:1;jenkins-hbase4:39881] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 19:10:37,001 DEBUG [RS:2;jenkins-hbase4:39767] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 19:10:37,001 DEBUG [RS:1;jenkins-hbase4:39881] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 19:10:37,001 DEBUG [RS:0;jenkins-hbase4:37775] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 19:10:37,001 DEBUG [RS:2;jenkins-hbase4:39767] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 19:10:37,002 DEBUG [RS:0;jenkins-hbase4:37775] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 19:10:37,007 DEBUG [RS:2;jenkins-hbase4:39767] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 19:10:37,007 DEBUG [RS:0;jenkins-hbase4:37775] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 19:10:37,007 DEBUG [RS:1;jenkins-hbase4:39881] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 19:10:37,009 DEBUG [RS:2;jenkins-hbase4:39767] zookeeper.ReadOnlyZKClient(139): Connect 0x55ca13ef to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:37,011 DEBUG [RS:0;jenkins-hbase4:37775] zookeeper.ReadOnlyZKClient(139): Connect 0x2c00055a to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:37,011 DEBUG [RS:1;jenkins-hbase4:39881] zookeeper.ReadOnlyZKClient(139): Connect 0x5a55e94d to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:37,067 DEBUG [RS:1;jenkins-hbase4:39881] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f576c63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:37,069 DEBUG [RS:1;jenkins-hbase4:39881] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2357b9de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 19:10:37,070 DEBUG [RS:0;jenkins-hbase4:37775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b364f51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:37,070 DEBUG [RS:2;jenkins-hbase4:39767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10c89732, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:37,070 DEBUG [RS:0;jenkins-hbase4:37775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@695608d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 19:10:37,070 DEBUG [RS:2;jenkins-hbase4:39767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c72e334, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 19:10:37,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 19:10:37,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:37,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 19:10:37,100 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39881 2023-07-19 19:10:37,102 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39767 2023-07-19 19:10:37,104 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37775 2023-07-19 19:10:37,107 INFO [RS:0;jenkins-hbase4:37775] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 19:10:37,107 INFO [RS:0;jenkins-hbase4:37775] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 19:10:37,107 INFO [RS:1;jenkins-hbase4:39881] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 19:10:37,108 INFO [RS:1;jenkins-hbase4:39881] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 19:10:37,108 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 19:10:37,108 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 19:10:37,107 INFO [RS:2;jenkins-hbase4:39767] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 19:10:37,109 INFO [RS:1;jenkins-hbase4:39881] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:37,109 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 19:10:37,112 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43163,1689793834027 with isa=jenkins-hbase4.apache.org/172.31.14.131:39881, startcode=1689793835575 2023-07-19 19:10:37,108 INFO [RS:0;jenkins-hbase4:37775] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:37,119 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 19:10:37,121 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43163,1689793834027 with isa=jenkins-hbase4.apache.org/172.31.14.131:37775, startcode=1689793835515 2023-07-19 19:10:37,109 INFO [RS:2;jenkins-hbase4:39767] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 19:10:37,124 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 19:10:37,125 INFO [RS:2;jenkins-hbase4:39767] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:37,125 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 19:10:37,126 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43163,1689793834027 with isa=jenkins-hbase4.apache.org/172.31.14.131:39767, startcode=1689793835630 2023-07-19 19:10:37,134 DEBUG [RS:0;jenkins-hbase4:37775] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 19:10:37,135 DEBUG [RS:1;jenkins-hbase4:39881] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 19:10:37,135 DEBUG [RS:2;jenkins-hbase4:39767] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 19:10:37,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 19:10:37,209 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50373, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 19:10:37,209 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48905, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 19:10:37,209 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48011, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 19:10:37,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 19:10:37,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 19:10:37,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 19:10:37,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 19:10:37,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 19:10:37,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 19:10:37,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689793867225 2023-07-19 19:10:37,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 19:10:37,230 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43163] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 19:10:37,233 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 19:10:37,234 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 19:10:37,241 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 19:10:37,241 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43163] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 19:10:37,249 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43163] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 19:10:37,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 19:10:37,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 19:10:37,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 19:10:37,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 19:10:37,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 19:10:37,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 19:10:37,275 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 19:10:37,276 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 19:10:37,276 WARN [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 19:10:37,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 19:10:37,275 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 19:10:37,276 WARN [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 19:10:37,277 WARN [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 19:10:37,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 19:10:37,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 19:10:37,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 19:10:37,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689793837290,5,FailOnTimeoutGroup] 2023-07-19 19:10:37,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689793837291,5,FailOnTimeoutGroup] 2023-07-19 19:10:37,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 19:10:37,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,329 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:37,330 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:37,330 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:10:37,368 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:37,371 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 19:10:37,376 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/info 2023-07-19 19:10:37,378 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 19:10:37,379 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43163,1689793834027 with isa=jenkins-hbase4.apache.org/172.31.14.131:39881, startcode=1689793835575 2023-07-19 19:10:37,379 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43163,1689793834027 with isa=jenkins-hbase4.apache.org/172.31.14.131:39767, startcode=1689793835630 2023-07-19 19:10:37,381 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43163,1689793834027 with isa=jenkins-hbase4.apache.org/172.31.14.131:37775, startcode=1689793835515 2023-07-19 19:10:37,384 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:37,385 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 19:10:37,387 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43163] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:37,388 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/rep_barrier 2023-07-19 19:10:37,389 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 19:10:37,390 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:37,390 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 19:10:37,393 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/table 2023-07-19 19:10:37,395 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43163] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:37,396 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:10:37,395 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 19:10:37,397 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39651 2023-07-19 19:10:37,397 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 19:10:37,398 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:37,399 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43163] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:37,401 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:10:37,401 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39651 2023-07-19 19:10:37,401 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 19:10:37,402 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740 2023-07-19 19:10:37,404 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740 2023-07-19 19:10:37,405 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:10:37,405 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39651 2023-07-19 19:10:37,405 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 19:10:37,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:10:37,410 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 19:10:37,417 DEBUG [RS:1;jenkins-hbase4:39881] zookeeper.ZKUtil(162): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:37,417 DEBUG [RS:0;jenkins-hbase4:37775] zookeeper.ZKUtil(162): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:37,418 DEBUG [RS:2;jenkins-hbase4:39767] zookeeper.ZKUtil(162): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:37,418 WARN [RS:1;jenkins-hbase4:39881] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 19:10:37,423 INFO [RS:1;jenkins-hbase4:39881] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:37,424 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:37,418 WARN [RS:0;jenkins-hbase4:37775] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 19:10:37,418 WARN [RS:2;jenkins-hbase4:39767] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 19:10:37,427 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 19:10:37,429 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39767,1689793835630] 2023-07-19 19:10:37,429 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37775,1689793835515] 2023-07-19 19:10:37,429 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39881,1689793835575] 2023-07-19 19:10:37,427 INFO [RS:0;jenkins-hbase4:37775] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:37,427 INFO [RS:2;jenkins-hbase4:39767] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:37,435 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:37,436 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:37,456 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:37,459 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67709109, jitterRate=0.008944347500801086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 19:10:37,460 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 19:10:37,460 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 19:10:37,460 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 19:10:37,460 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 19:10:37,460 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 19:10:37,460 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 19:10:37,463 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 19:10:37,463 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 19:10:37,468 DEBUG [RS:0;jenkins-hbase4:37775] zookeeper.ZKUtil(162): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:37,469 DEBUG [RS:2;jenkins-hbase4:39767] zookeeper.ZKUtil(162): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:37,469 DEBUG [RS:1;jenkins-hbase4:39881] zookeeper.ZKUtil(162): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:37,469 DEBUG [RS:0;jenkins-hbase4:37775] zookeeper.ZKUtil(162): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:37,469 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 19:10:37,470 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 19:10:37,470 DEBUG [RS:1;jenkins-hbase4:39881] zookeeper.ZKUtil(162): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:37,470 DEBUG [RS:0;jenkins-hbase4:37775] zookeeper.ZKUtil(162): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:37,470 DEBUG [RS:2;jenkins-hbase4:39767] zookeeper.ZKUtil(162): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:37,471 DEBUG [RS:2;jenkins-hbase4:39767] zookeeper.ZKUtil(162): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:37,472 DEBUG [RS:1;jenkins-hbase4:39881] zookeeper.ZKUtil(162): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:37,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 19:10:37,485 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 19:10:37,485 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 19:10:37,485 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 19:10:37,499 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 19:10:37,499 INFO [RS:0;jenkins-hbase4:37775] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 19:10:37,500 INFO [RS:1;jenkins-hbase4:39881] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 19:10:37,499 INFO [RS:2;jenkins-hbase4:39767] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 19:10:37,515 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 19:10:37,537 INFO [RS:2;jenkins-hbase4:39767] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 19:10:37,537 INFO [RS:0;jenkins-hbase4:37775] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 19:10:37,537 INFO [RS:1;jenkins-hbase4:39881] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 19:10:37,543 INFO [RS:2;jenkins-hbase4:39767] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 19:10:37,543 INFO [RS:1;jenkins-hbase4:39881] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 19:10:37,543 INFO [RS:0;jenkins-hbase4:37775] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 19:10:37,544 INFO [RS:1;jenkins-hbase4:39881] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,544 INFO [RS:0;jenkins-hbase4:37775] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,544 INFO [RS:2;jenkins-hbase4:39767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,546 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 19:10:37,546 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 19:10:37,546 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 19:10:37,557 INFO [RS:0;jenkins-hbase4:37775] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,557 INFO [RS:1;jenkins-hbase4:39881] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,557 INFO [RS:2;jenkins-hbase4:39767] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,558 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,558 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,559 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,559 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,559 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,559 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,559 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,559 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,559 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,559 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,559 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 19:10:37,559 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 19:10:37,560 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,560 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,560 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,560 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,560 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,560 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,560 DEBUG [RS:0;jenkins-hbase4:37775] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,560 DEBUG [RS:1;jenkins-hbase4:39881] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,564 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,564 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,564 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,564 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,564 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,564 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 19:10:37,565 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,565 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,565 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,565 DEBUG [RS:2;jenkins-hbase4:39767] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,579 INFO [RS:0;jenkins-hbase4:37775] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,579 INFO [RS:0;jenkins-hbase4:37775] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,579 INFO [RS:0;jenkins-hbase4:37775] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,602 INFO [RS:1;jenkins-hbase4:39881] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,603 INFO [RS:1;jenkins-hbase4:39881] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,603 INFO [RS:1;jenkins-hbase4:39881] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,611 INFO [RS:2;jenkins-hbase4:39767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,612 INFO [RS:2;jenkins-hbase4:39767] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,612 INFO [RS:2;jenkins-hbase4:39767] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,625 INFO [RS:0;jenkins-hbase4:37775] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 19:10:37,629 INFO [RS:0;jenkins-hbase4:37775] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37775,1689793835515-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,636 INFO [RS:2;jenkins-hbase4:39767] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 19:10:37,637 INFO [RS:2;jenkins-hbase4:39767] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39767,1689793835630-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,656 INFO [RS:1;jenkins-hbase4:39881] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 19:10:37,656 INFO [RS:1;jenkins-hbase4:39881] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39881,1689793835575-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,667 DEBUG [jenkins-hbase4:43163] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 19:10:37,672 DEBUG [jenkins-hbase4:43163] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:10:37,672 INFO [RS:0;jenkins-hbase4:37775] regionserver.Replication(203): jenkins-hbase4.apache.org,37775,1689793835515 started 2023-07-19 19:10:37,672 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37775,1689793835515, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37775, sessionid=0x1017efe2b4a0001 2023-07-19 19:10:37,672 DEBUG [RS:0;jenkins-hbase4:37775] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 19:10:37,672 DEBUG [RS:0;jenkins-hbase4:37775] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:37,672 DEBUG [RS:0;jenkins-hbase4:37775] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37775,1689793835515' 2023-07-19 19:10:37,673 DEBUG [RS:0;jenkins-hbase4:37775] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 19:10:37,673 DEBUG [RS:0;jenkins-hbase4:37775] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 19:10:37,674 INFO [RS:2;jenkins-hbase4:39767] regionserver.Replication(203): jenkins-hbase4.apache.org,39767,1689793835630 started 2023-07-19 19:10:37,674 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39767,1689793835630, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39767, sessionid=0x1017efe2b4a0003 2023-07-19 19:10:37,674 DEBUG [RS:2;jenkins-hbase4:39767] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 19:10:37,674 DEBUG [RS:2;jenkins-hbase4:39767] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:37,691 DEBUG [jenkins-hbase4:43163] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:10:37,691 DEBUG [jenkins-hbase4:43163] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:10:37,692 DEBUG [jenkins-hbase4:43163] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:10:37,692 DEBUG [jenkins-hbase4:43163] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:10:37,696 DEBUG [RS:0;jenkins-hbase4:37775] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 19:10:37,696 DEBUG [RS:0;jenkins-hbase4:37775] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 19:10:37,696 DEBUG [RS:0;jenkins-hbase4:37775] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:37,696 DEBUG [RS:0;jenkins-hbase4:37775] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37775,1689793835515' 2023-07-19 19:10:37,696 DEBUG [RS:0;jenkins-hbase4:37775] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:37,697 DEBUG [RS:0;jenkins-hbase4:37775] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:37,698 DEBUG [RS:0;jenkins-hbase4:37775] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 19:10:37,698 INFO [RS:0;jenkins-hbase4:37775] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 19:10:37,698 INFO [RS:0;jenkins-hbase4:37775] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 19:10:37,698 INFO [RS:1;jenkins-hbase4:39881] regionserver.Replication(203): jenkins-hbase4.apache.org,39881,1689793835575 started 2023-07-19 19:10:37,684 DEBUG [RS:2;jenkins-hbase4:39767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39767,1689793835630' 2023-07-19 19:10:37,707 DEBUG [RS:2;jenkins-hbase4:39767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 19:10:37,707 DEBUG [RS:2;jenkins-hbase4:39767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 19:10:37,708 DEBUG [RS:2;jenkins-hbase4:39767] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 19:10:37,708 DEBUG [RS:2;jenkins-hbase4:39767] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 19:10:37,708 DEBUG [RS:2;jenkins-hbase4:39767] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:37,709 DEBUG [RS:2;jenkins-hbase4:39767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39767,1689793835630' 2023-07-19 19:10:37,709 DEBUG [RS:2;jenkins-hbase4:39767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:37,710 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37775,1689793835515, state=OPENING 2023-07-19 19:10:37,707 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39881,1689793835575, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39881, sessionid=0x1017efe2b4a0002 2023-07-19 19:10:37,712 DEBUG [RS:1;jenkins-hbase4:39881] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 19:10:37,712 DEBUG [RS:1;jenkins-hbase4:39881] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:37,712 DEBUG [RS:1;jenkins-hbase4:39881] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39881,1689793835575' 2023-07-19 19:10:37,712 DEBUG [RS:1;jenkins-hbase4:39881] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 19:10:37,713 DEBUG [RS:1;jenkins-hbase4:39881] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 19:10:37,713 DEBUG [RS:1;jenkins-hbase4:39881] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 19:10:37,713 DEBUG [RS:1;jenkins-hbase4:39881] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 19:10:37,713 DEBUG [RS:1;jenkins-hbase4:39881] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:37,713 DEBUG [RS:1;jenkins-hbase4:39881] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39881,1689793835575' 2023-07-19 19:10:37,713 DEBUG [RS:1;jenkins-hbase4:39881] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:37,714 DEBUG [RS:1;jenkins-hbase4:39881] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:37,715 DEBUG [RS:1;jenkins-hbase4:39881] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 19:10:37,715 INFO [RS:1;jenkins-hbase4:39881] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 19:10:37,715 DEBUG [RS:2;jenkins-hbase4:39767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:37,715 INFO [RS:1;jenkins-hbase4:39881] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 19:10:37,716 DEBUG [RS:2;jenkins-hbase4:39767] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 19:10:37,717 INFO [RS:2;jenkins-hbase4:39767] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 19:10:37,717 INFO [RS:2;jenkins-hbase4:39767] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 19:10:37,721 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 19:10:37,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:37,724 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 19:10:37,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37775,1689793835515}] 2023-07-19 19:10:37,814 INFO [RS:0;jenkins-hbase4:37775] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37775%2C1689793835515, suffix=, logDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,37775,1689793835515, archiveDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/oldWALs, maxLogs=32 2023-07-19 19:10:37,824 INFO [RS:2;jenkins-hbase4:39767] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39767%2C1689793835630, suffix=, logDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,39767,1689793835630, archiveDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/oldWALs, maxLogs=32 2023-07-19 19:10:37,833 INFO [RS:1;jenkins-hbase4:39881] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39881%2C1689793835575, suffix=, logDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,39881,1689793835575, archiveDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/oldWALs, maxLogs=32 2023-07-19 19:10:37,850 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK] 2023-07-19 19:10:37,850 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK] 2023-07-19 19:10:37,855 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK] 2023-07-19 19:10:37,901 INFO [RS:0;jenkins-hbase4:37775] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,37775,1689793835515/jenkins-hbase4.apache.org%2C37775%2C1689793835515.1689793837818 2023-07-19 19:10:37,903 DEBUG [RS:0;jenkins-hbase4:37775] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK], DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK], DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK]] 2023-07-19 19:10:37,908 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK] 2023-07-19 19:10:37,908 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK] 2023-07-19 19:10:37,917 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK] 2023-07-19 19:10:37,917 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK] 2023-07-19 19:10:37,918 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK] 2023-07-19 19:10:37,920 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK] 2023-07-19 19:10:37,927 INFO [RS:2;jenkins-hbase4:39767] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,39767,1689793835630/jenkins-hbase4.apache.org%2C39767%2C1689793835630.1689793837827 2023-07-19 19:10:37,929 DEBUG [RS:2;jenkins-hbase4:39767] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK], DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK], DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK]] 2023-07-19 19:10:37,939 INFO [RS:1;jenkins-hbase4:39881] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,39881,1689793835575/jenkins-hbase4.apache.org%2C39881%2C1689793835575.1689793837835 2023-07-19 19:10:37,955 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:37,970 DEBUG [RS:1;jenkins-hbase4:39881] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK], DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK], DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK]] 2023-07-19 19:10:37,972 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:10:37,996 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:10:38,024 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 19:10:38,025 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:38,036 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37775%2C1689793835515.meta, suffix=.meta, logDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,37775,1689793835515, archiveDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/oldWALs, maxLogs=32 2023-07-19 19:10:38,065 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK] 2023-07-19 19:10:38,066 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK] 2023-07-19 19:10:38,084 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK] 2023-07-19 19:10:38,096 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/WALs/jenkins-hbase4.apache.org,37775,1689793835515/jenkins-hbase4.apache.org%2C37775%2C1689793835515.meta.1689793838037.meta 2023-07-19 19:10:38,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37561,DS-fc4a1117-2da7-4c50-bb54-a6f72ac34c57,DISK], DatanodeInfoWithStorage[127.0.0.1:39611,DS-46ab7883-ba73-4565-92e3-40c0986912a1,DISK], DatanodeInfoWithStorage[127.0.0.1:44549,DS-3a2cbc81-4517-4f7d-a480-ab624c9ac4ba,DISK]] 2023-07-19 19:10:38,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:10:38,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 19:10:38,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:38,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 19:10:38,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 19:10:38,108 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 19:10:38,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 19:10:38,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:38,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 19:10:38,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 19:10:38,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 19:10:38,130 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/info 2023-07-19 19:10:38,130 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/info 2023-07-19 19:10:38,131 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 19:10:38,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:38,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 19:10:38,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/rep_barrier 2023-07-19 19:10:38,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/rep_barrier 2023-07-19 19:10:38,135 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 19:10:38,136 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:38,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 19:10:38,138 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/table 2023-07-19 19:10:38,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/table 2023-07-19 19:10:38,139 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 19:10:38,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:38,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740 2023-07-19 19:10:38,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740 2023-07-19 19:10:38,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 19:10:38,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 19:10:38,158 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63605753, jitterRate=-0.05220042169094086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 19:10:38,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 19:10:38,173 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689793837944 2023-07-19 19:10:38,193 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 19:10:38,194 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 19:10:38,195 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37775,1689793835515, state=OPEN 2023-07-19 19:10:38,199 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 19:10:38,199 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 19:10:38,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 19:10:38,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37775,1689793835515 in 470 msec 2023-07-19 19:10:38,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 19:10:38,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 726 msec 2023-07-19 19:10:38,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1260 sec 2023-07-19 19:10:38,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689793838218, completionTime=-1 2023-07-19 19:10:38,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 19:10:38,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 19:10:38,286 DEBUG [hconnection-0x36059dc5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:38,290 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:38,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 19:10:38,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689793898330 2023-07-19 19:10:38,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689793958330 2023-07-19 19:10:38,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 111 msec 2023-07-19 19:10:38,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43163,1689793834027-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43163,1689793834027-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43163,1689793834027-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43163, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,382 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 19:10:38,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 19:10:38,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 19:10:38,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 19:10:38,414 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:10:38,419 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:10:38,454 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:10:38,458 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35 empty. 2023-07-19 19:10:38,459 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:10:38,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 19:10:38,529 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:38,531 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1b0b164eedb06b4681d87dbd042d0e35, NAME => 'hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:10:38,563 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:38,563 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1b0b164eedb06b4681d87dbd042d0e35, disabling compactions & flushes 2023-07-19 19:10:38,563 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:10:38,563 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:10:38,563 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. after waiting 0 ms 2023-07-19 19:10:38,563 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:10:38,563 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:10:38,564 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1b0b164eedb06b4681d87dbd042d0e35: 2023-07-19 19:10:38,572 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:10:38,596 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689793838576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793838576"}]},"ts":"1689793838576"} 2023-07-19 19:10:38,634 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 19:10:38,636 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:10:38,641 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793838637"}]},"ts":"1689793838637"} 2023-07-19 19:10:38,649 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 19:10:38,653 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:10:38,655 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:10:38,655 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:10:38,655 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:10:38,655 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:10:38,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1b0b164eedb06b4681d87dbd042d0e35, ASSIGN}] 2023-07-19 19:10:38,663 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1b0b164eedb06b4681d87dbd042d0e35, ASSIGN 2023-07-19 19:10:38,666 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1b0b164eedb06b4681d87dbd042d0e35, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39767,1689793835630; forceNewPlan=false, retain=false 2023-07-19 19:10:38,820 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 19:10:38,821 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1b0b164eedb06b4681d87dbd042d0e35, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:38,822 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689793838821"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793838821"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793838821"}]},"ts":"1689793838821"} 2023-07-19 19:10:38,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1b0b164eedb06b4681d87dbd042d0e35, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:10:38,996 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:38,997 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:10:39,000 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:10:39,006 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:10:39,006 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b0b164eedb06b4681d87dbd042d0e35, NAME => 'hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35.', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:10:39,007 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. service=AccessControlService 2023-07-19 19:10:39,007 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:39,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:10:39,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:39,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:10:39,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:10:39,011 INFO [StoreOpener-1b0b164eedb06b4681d87dbd042d0e35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:10:39,013 DEBUG [StoreOpener-1b0b164eedb06b4681d87dbd042d0e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35/info 2023-07-19 19:10:39,013 DEBUG [StoreOpener-1b0b164eedb06b4681d87dbd042d0e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35/info 2023-07-19 19:10:39,014 INFO [StoreOpener-1b0b164eedb06b4681d87dbd042d0e35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b0b164eedb06b4681d87dbd042d0e35 columnFamilyName info 2023-07-19 19:10:39,015 INFO [StoreOpener-1b0b164eedb06b4681d87dbd042d0e35-1] regionserver.HStore(310): Store=1b0b164eedb06b4681d87dbd042d0e35/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:39,016 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:10:39,018 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:10:39,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:10:39,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:39,032 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b0b164eedb06b4681d87dbd042d0e35; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67600372, jitterRate=0.007324039936065674}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:39,032 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b0b164eedb06b4681d87dbd042d0e35: 2023-07-19 19:10:39,036 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35., pid=6, masterSystemTime=1689793838996 2023-07-19 19:10:39,040 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:10:39,041 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:10:39,042 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1b0b164eedb06b4681d87dbd042d0e35, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:39,043 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689793839042"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793839042"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793839042"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793839042"}]},"ts":"1689793839042"} 2023-07-19 19:10:39,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 19:10:39,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1b0b164eedb06b4681d87dbd042d0e35, server=jenkins-hbase4.apache.org,39767,1689793835630 in 210 msec 2023-07-19 19:10:39,053 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 19:10:39,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1b0b164eedb06b4681d87dbd042d0e35, ASSIGN in 390 msec 2023-07-19 19:10:39,055 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:10:39,055 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793839055"}]},"ts":"1689793839055"} 2023-07-19 19:10:39,058 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 19:10:39,061 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:10:39,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 667 msec 2023-07-19 19:10:39,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 19:10:39,118 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 19:10:39,118 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:39,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:39,147 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:39,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 19:10:39,178 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 19:10:39,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-19 19:10:39,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 19:10:39,205 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 19:10:39,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-19 19:10:39,220 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 19:10:39,224 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 19:10:39,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.493sec 2023-07-19 19:10:39,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 19:10:39,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 19:10:39,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 19:10:39,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43163,1689793834027-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 19:10:39,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43163,1689793834027-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 19:10:39,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 19:10:39,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 19:10:39,267 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:10:39,268 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:10:39,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 19:10:39,279 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:10:39,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 19:10:39,280 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a empty. 2023-07-19 19:10:39,284 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:10:39,285 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 19:10:39,293 DEBUG [Listener at localhost/40019] zookeeper.ReadOnlyZKClient(139): Connect 0x5f9eca1b to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:39,308 DEBUG [Listener at localhost/40019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68214c6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:39,364 DEBUG [hconnection-0xc46609f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:39,365 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:39,372 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 02bf08a6134737f44c9fcfba39b4ef7a, NAME => 'hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:10:39,384 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:39,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 19:10:39,388 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:10:39,388 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 19:10:39,388 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/test.cache.data in system properties and HBase conf 2023-07-19 19:10:39,389 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 19:10:39,389 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop.log.dir in system properties and HBase conf 2023-07-19 19:10:39,389 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 19:10:39,389 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 19:10:39,389 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/nfs.dump.dir in system properties and HBase conf 2023-07-19 19:10:39,390 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir in system properties and HBase conf 2023-07-19 19:10:39,391 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 19:10:39,392 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 19:10:39,394 INFO [Listener at localhost/40019] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 19:10:39,400 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:39,401 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 02bf08a6134737f44c9fcfba39b4ef7a, disabling compactions & flushes 2023-07-19 19:10:39,401 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:10:39,401 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:10:39,401 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. after waiting 0 ms 2023-07-19 19:10:39,401 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:10:39,401 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:10:39,401 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 02bf08a6134737f44c9fcfba39b4ef7a: 2023-07-19 19:10:39,406 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:10:39,408 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689793839407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793839407"}]},"ts":"1689793839407"} 2023-07-19 19:10:39,411 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 19:10:39,418 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:10:39,419 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793839419"}]},"ts":"1689793839419"} 2023-07-19 19:10:39,421 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 19:10:39,427 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:10:39,429 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:10:39,429 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:10:39,429 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:10:39,429 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:10:39,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=02bf08a6134737f44c9fcfba39b4ef7a, ASSIGN}] 2023-07-19 19:10:39,433 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=02bf08a6134737f44c9fcfba39b4ef7a, ASSIGN 2023-07-19 19:10:39,435 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=02bf08a6134737f44c9fcfba39b4ef7a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39881,1689793835575; forceNewPlan=false, retain=false 2023-07-19 19:10:39,585 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 19:10:39,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 19:10:39,587 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=02bf08a6134737f44c9fcfba39b4ef7a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:39,587 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689793839587"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793839587"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793839587"}]},"ts":"1689793839587"} 2023-07-19 19:10:39,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 02bf08a6134737f44c9fcfba39b4ef7a, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:10:39,745 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:39,746 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:10:39,761 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:10:39,772 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:10:39,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02bf08a6134737f44c9fcfba39b4ef7a, NAME => 'hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a.', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:10:39,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. service=AccessControlService 2023-07-19 19:10:39,773 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:39,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:10:39,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:39,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:10:39,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:10:39,783 INFO [StoreOpener-02bf08a6134737f44c9fcfba39b4ef7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:10:39,786 DEBUG [StoreOpener-02bf08a6134737f44c9fcfba39b4ef7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a/l 2023-07-19 19:10:39,786 DEBUG [StoreOpener-02bf08a6134737f44c9fcfba39b4ef7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a/l 2023-07-19 19:10:39,787 INFO [StoreOpener-02bf08a6134737f44c9fcfba39b4ef7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02bf08a6134737f44c9fcfba39b4ef7a columnFamilyName l 2023-07-19 19:10:39,788 INFO [StoreOpener-02bf08a6134737f44c9fcfba39b4ef7a-1] regionserver.HStore(310): Store=02bf08a6134737f44c9fcfba39b4ef7a/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:39,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:10:39,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:10:39,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:10:39,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:39,811 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 02bf08a6134737f44c9fcfba39b4ef7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67073328, jitterRate=-5.295276641845703E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:39,811 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 02bf08a6134737f44c9fcfba39b4ef7a: 2023-07-19 19:10:39,813 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a., pid=11, masterSystemTime=1689793839745 2023-07-19 19:10:39,818 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:10:39,819 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:10:39,820 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=02bf08a6134737f44c9fcfba39b4ef7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:39,820 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689793839820"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793839820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793839820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793839820"}]},"ts":"1689793839820"} 2023-07-19 19:10:39,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 19:10:39,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 02bf08a6134737f44c9fcfba39b4ef7a, server=jenkins-hbase4.apache.org,39881,1689793835575 in 236 msec 2023-07-19 19:10:39,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 19:10:39,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=02bf08a6134737f44c9fcfba39b4ef7a, ASSIGN in 400 msec 2023-07-19 19:10:39,835 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:10:39,835 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793839835"}]},"ts":"1689793839835"} 2023-07-19 19:10:39,838 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 19:10:39,841 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:10:39,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 579 msec 2023-07-19 19:10:39,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 19:10:39,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 19:10:39,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 19:10:40,732 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:41,065 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:41,071 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42663_jobhistory____.y8kspu/webapp 2023-07-19 19:10:41,238 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 19:10:41,238 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 19:10:41,238 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 19:10:41,240 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 19:10:41,307 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:41,593 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:41,914 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 19:10:41,947 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42663 2023-07-19 19:10:42,247 WARN [Listener at jenkins-hbase4.apache.org/45239] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:42,673 WARN [Listener at jenkins-hbase4.apache.org/45239] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 19:10:42,674 INFO [Listener at jenkins-hbase4.apache.org/45239] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:42,692 INFO [Listener at jenkins-hbase4.apache.org/45239] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41439_cluster____y0o1af/webapp 2023-07-19 19:10:42,829 INFO [Listener at jenkins-hbase4.apache.org/45239] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 19:10:42,830 INFO [Listener at jenkins-hbase4.apache.org/45239] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 19:10:42,830 INFO [Listener at jenkins-hbase4.apache.org/45239] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 19:10:42,830 INFO [Listener at jenkins-hbase4.apache.org/45239] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 19:10:42,841 INFO [Listener at jenkins-hbase4.apache.org/45239] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:43,114 INFO [Listener at jenkins-hbase4.apache.org/45239] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:43,370 INFO [Listener at jenkins-hbase4.apache.org/45239] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:43,383 INFO [Listener at jenkins-hbase4.apache.org/45239] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41439 2023-07-19 19:10:43,758 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:10:44,010 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 19:10:44,012 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 19:10:44,013 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 19:10:44,206 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:10:44,207 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 19:10:44,208 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:10:44,208 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 19:10:44,208 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 19:10:44,208 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 19:10:44,208 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:10:44,208 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 19:10:44,208 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 19:10:44,208 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 19:10:44,442 WARN [Listener at jenkins-hbase4.apache.org/33985] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:44,470 WARN [Listener at jenkins-hbase4.apache.org/33985] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 19:10:44,471 INFO [Listener at jenkins-hbase4.apache.org/33985] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:44,481 INFO [Listener at jenkins-hbase4.apache.org/33985] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45171_node____.ou874o/webapp 2023-07-19 19:10:44,551 INFO [Listener at jenkins-hbase4.apache.org/33985] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 19:10:44,551 INFO [Listener at jenkins-hbase4.apache.org/33985] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 19:10:44,552 INFO [Listener at jenkins-hbase4.apache.org/33985] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 19:10:44,552 INFO [Listener at jenkins-hbase4.apache.org/33985] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 19:10:44,563 INFO [Listener at jenkins-hbase4.apache.org/33985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:44,587 INFO [Listener at jenkins-hbase4.apache.org/33985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:44,684 INFO [Listener at jenkins-hbase4.apache.org/33985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:44,697 INFO [Listener at jenkins-hbase4.apache.org/33985] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45171 2023-07-19 19:10:44,947 WARN [Listener at jenkins-hbase4.apache.org/41077] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:44,954 WARN [Listener at jenkins-hbase4.apache.org/41077] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 19:10:44,955 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:44,962 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35131_node____.6zjor9/webapp 2023-07-19 19:10:45,020 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 19:10:45,021 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 19:10:45,021 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 19:10:45,021 INFO [Listener at jenkins-hbase4.apache.org/41077] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 19:10:45,031 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:45,048 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:45,119 INFO [Listener at jenkins-hbase4.apache.org/41077] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:45,131 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35131 2023-07-19 19:10:45,157 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 19:10:45,159 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:10:45,233 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=377, ProcessCount=176, AvailableMemoryMB=4768 2023-07-19 19:10:45,233 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-07-19 19:10:45,248 DEBUG [Listener at jenkins-hbase4.apache.org/41077] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 19:10:45,254 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 19:10:45,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:10:45,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:10:45,268 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:10:45,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 19:10:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:45,271 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:10:45,276 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:10:45,276 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d 2023-07-19 19:10:45,278 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095 empty. 2023-07-19 19:10:45,279 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:10:45,280 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d empty. 2023-07-19 19:10:45,282 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d 2023-07-19 19:10:45,282 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 19:10:45,310 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:45,312 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => d0c37e2d488b0bc1fa450da19a208095, NAME => 'testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:10:45,312 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 23139d5277aab311e937517f4da1327d, NAME => 'testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:10:45,357 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:45,357 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 23139d5277aab311e937517f4da1327d, disabling compactions & flushes 2023-07-19 19:10:45,357 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:45,357 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:45,357 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. after waiting 0 ms 2023-07-19 19:10:45,357 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:45,357 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:45,357 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 23139d5277aab311e937517f4da1327d: 2023-07-19 19:10:45,359 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:45,360 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing d0c37e2d488b0bc1fa450da19a208095, disabling compactions & flushes 2023-07-19 19:10:45,360 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:45,360 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:45,360 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. after waiting 0 ms 2023-07-19 19:10:45,360 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:45,360 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:45,360 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for d0c37e2d488b0bc1fa450da19a208095: 2023-07-19 19:10:45,366 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:10:45,367 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793845367"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793845367"}]},"ts":"1689793845367"} 2023-07-19 19:10:45,368 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793845367"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793845367"}]},"ts":"1689793845367"} 2023-07-19 19:10:45,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:45,431 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:10:45,433 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:10:45,434 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793845433"}]},"ts":"1689793845433"} 2023-07-19 19:10:45,436 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 19:10:45,442 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:10:45,445 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:10:45,445 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:10:45,445 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:10:45,445 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:10:45,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0c37e2d488b0bc1fa450da19a208095, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=23139d5277aab311e937517f4da1327d, ASSIGN}] 2023-07-19 19:10:45,449 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=23139d5277aab311e937517f4da1327d, ASSIGN 2023-07-19 19:10:45,449 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0c37e2d488b0bc1fa450da19a208095, ASSIGN 2023-07-19 19:10:45,450 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=23139d5277aab311e937517f4da1327d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39767,1689793835630; forceNewPlan=false, retain=false 2023-07-19 19:10:45,451 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0c37e2d488b0bc1fa450da19a208095, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39881,1689793835575; forceNewPlan=false, retain=false 2023-07-19 19:10:45,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:45,601 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:10:45,603 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=23139d5277aab311e937517f4da1327d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:45,603 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d0c37e2d488b0bc1fa450da19a208095, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:45,604 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793845603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793845603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793845603"}]},"ts":"1689793845603"} 2023-07-19 19:10:45,604 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793845603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793845603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793845603"}]},"ts":"1689793845603"} 2023-07-19 19:10:45,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 23139d5277aab311e937517f4da1327d, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:10:45,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure d0c37e2d488b0bc1fa450da19a208095, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:10:45,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:45,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:45,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 23139d5277aab311e937517f4da1327d, NAME => 'testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:10:45,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0c37e2d488b0bc1fa450da19a208095, NAME => 'testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:10:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. service=AccessControlService 2023-07-19 19:10:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. service=AccessControlService 2023-07-19 19:10:45,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:45,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:10:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 23139d5277aab311e937517f4da1327d 2023-07-19 19:10:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:10:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 23139d5277aab311e937517f4da1327d 2023-07-19 19:10:45,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:10:45,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 23139d5277aab311e937517f4da1327d 2023-07-19 19:10:45,775 INFO [StoreOpener-23139d5277aab311e937517f4da1327d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 23139d5277aab311e937517f4da1327d 2023-07-19 19:10:45,778 INFO [StoreOpener-d0c37e2d488b0bc1fa450da19a208095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:10:45,780 DEBUG [StoreOpener-23139d5277aab311e937517f4da1327d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/cf 2023-07-19 19:10:45,780 DEBUG [StoreOpener-23139d5277aab311e937517f4da1327d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/cf 2023-07-19 19:10:45,781 INFO [StoreOpener-23139d5277aab311e937517f4da1327d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23139d5277aab311e937517f4da1327d columnFamilyName cf 2023-07-19 19:10:45,782 DEBUG [StoreOpener-d0c37e2d488b0bc1fa450da19a208095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/cf 2023-07-19 19:10:45,782 DEBUG [StoreOpener-d0c37e2d488b0bc1fa450da19a208095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/cf 2023-07-19 19:10:45,782 INFO [StoreOpener-23139d5277aab311e937517f4da1327d-1] regionserver.HStore(310): Store=23139d5277aab311e937517f4da1327d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:45,784 INFO [StoreOpener-d0c37e2d488b0bc1fa450da19a208095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0c37e2d488b0bc1fa450da19a208095 columnFamilyName cf 2023-07-19 19:10:45,785 INFO [StoreOpener-d0c37e2d488b0bc1fa450da19a208095-1] regionserver.HStore(310): Store=d0c37e2d488b0bc1fa450da19a208095/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:45,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d 2023-07-19 19:10:45,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d 2023-07-19 19:10:45,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:10:45,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:10:45,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 23139d5277aab311e937517f4da1327d 2023-07-19 19:10:45,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:10:45,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:45,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 23139d5277aab311e937517f4da1327d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61154736, jitterRate=-0.08872342109680176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:45,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 23139d5277aab311e937517f4da1327d: 2023-07-19 19:10:45,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:45,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d0c37e2d488b0bc1fa450da19a208095; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66588914, jitterRate=-0.007747858762741089}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:45,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d0c37e2d488b0bc1fa450da19a208095: 2023-07-19 19:10:45,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d., pid=15, masterSystemTime=1689793845759 2023-07-19 19:10:45,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095., pid=16, masterSystemTime=1689793845761 2023-07-19 19:10:45,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:45,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:45,809 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=23139d5277aab311e937517f4da1327d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:45,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:45,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:45,810 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793845809"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793845809"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793845809"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793845809"}]},"ts":"1689793845809"} 2023-07-19 19:10:45,811 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d0c37e2d488b0bc1fa450da19a208095, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:45,812 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793845811"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793845811"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793845811"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793845811"}]},"ts":"1689793845811"} 2023-07-19 19:10:45,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-19 19:10:45,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 23139d5277aab311e937517f4da1327d, server=jenkins-hbase4.apache.org,39767,1689793835630 in 208 msec 2023-07-19 19:10:45,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=23139d5277aab311e937517f4da1327d, ASSIGN in 374 msec 2023-07-19 19:10:45,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-19 19:10:45,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure d0c37e2d488b0bc1fa450da19a208095, server=jenkins-hbase4.apache.org,39881,1689793835575 in 209 msec 2023-07-19 19:10:45,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-19 19:10:45,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0c37e2d488b0bc1fa450da19a208095, ASSIGN in 381 msec 2023-07-19 19:10:45,830 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:10:45,830 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793845830"}]},"ts":"1689793845830"} 2023-07-19 19:10:45,832 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 19:10:45,835 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:10:45,841 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 19:10:45,846 DEBUG [PEWorker-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:45,849 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:45,853 DEBUG [hconnection-0x77281d1b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:45,856 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-19 19:10:45,864 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 19:10:45,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:45,900 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 19:10:45,900 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 19:10:45,900 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 19:10:45,900 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:45,900 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 19:10:45,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 19:10:45,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 19:10:45,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 19:10:45,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 19:10:45,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 647 msec 2023-07-19 19:10:46,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:46,382 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 19:10:46,382 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-19 19:10:46,383 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:10:46,387 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-19 19:10:46,388 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:10:46,388 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-19 19:10:46,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:46,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793846404 (current time:1689793846404). 2023-07-19 19:10:46,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:10:46,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x485db17b to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:46,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22a396ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:46,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:46,419 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:46,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x485db17b to 127.0.0.1:50021 2023-07-19 19:10:46,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:10:46,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x779b6074 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:46,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13aaa5f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:46,432 DEBUG [hconnection-0xe9e0af4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:46,434 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:46,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:46,440 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:46,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x779b6074 to 127.0.0.1:50021 2023-07-19 19:10:46,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:10:46,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 19:10:46,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:10:46,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:46,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:46,492 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:46,494 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689794446494 2023-07-19 19:10:46,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:46,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 19:10:46,498 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:46,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:46,500 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-07-19 19:10:46,501 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:46,503 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:10:46,503 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:10:46,504 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689794446504 2023-07-19 19:10:46,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,537 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 19:10:46,537 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:46,538 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 19:10:46,538 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 19:10:46,539 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,540 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,544 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,544 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,544 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,544 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,545 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,545 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,546 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,546 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:10:46,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 19:10:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 19:10:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 19:10:46,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,547 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:46,547 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:46,547 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:46,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:46,552 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:46,552 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:46,552 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:46,553 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:46,554 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:46,554 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:46,553 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:46,554 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:46,554 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:46,554 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:46,556 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,557 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,560 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,561 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,561 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:46,563 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,563 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,563 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:46,563 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:46,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 19:10:46,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257adbe7[Count = 1] remaining members to acquire global barrier 2023-07-19 19:10:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 19:10:46,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257adbe7[Count = 0] remaining members to acquire global barrier 2023-07-19 19:10:46,570 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 19:10:46,570 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:46,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:46,573 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:10:46,573 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,573 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:46,574 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,574 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:10:46,574 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:10:46,575 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:10:46,575 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:10:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:10:46,576 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:46,576 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. started... 2023-07-19 19:10:46,576 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:46,577 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. started... 2023-07-19 19:10:46,577 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:46,581 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0c37e2d488b0bc1fa450da19a208095: 2023-07-19 19:10:46,581 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 23139d5277aab311e937517f4da1327d: 2023-07-19 19:10:46,582 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,582 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,589 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:10:46,589 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:10:46,593 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:10:46,593 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:10:46,604 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:46,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:46,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:46,613 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:10:46,673 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. completed. 2023-07-19 19:10:46,673 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. completed. 2023-07-19 19:10:46,674 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:46,674 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:10:46,674 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:10:46,674 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,674 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:46,674 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:10:46,674 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:46,675 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:10:46,675 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:10:46,675 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,675 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:46,675 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:10:46,677 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,677 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,677 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:46,677 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:46,678 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:46,678 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,679 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:46,679 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:46,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39767,1689793835630': 2023-07-19 19:10:46,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 19:10:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39881,1689793835575': 2023-07-19 19:10:46,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 19:10:46,695 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 19:10:46,695 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:10:46,695 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:10:46,695 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,695 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:10:46,700 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,700 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,700 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,700 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,700 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,700 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,700 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,701 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,702 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,703 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,706 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,706 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,707 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,722 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,722 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,722 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,722 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,722 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,723 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,723 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:46,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:46,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:46,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,814 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:46,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:46,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:46,815 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:10:46,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 19:10:46,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,880 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689793846494Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689793846724 (+230 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689793846725 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689793846738 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689793846760 (+22 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689793846879 (+119 ms) 2023-07-19 19:10:46,885 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:46,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 388 msec 2023-07-19 19:10:47,116 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:47,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:47,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:10:47,138 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:47,138 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:47,145 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:47,145 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:47,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39881] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:10:47,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39767] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:10:47,154 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 19:10:47,155 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:47,157 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:10:47,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:47,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793847185 (current time:1689793847185). 2023-07-19 19:10:47,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:10:47,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x69347da3 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:47,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6efe75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:47,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:47,197 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:47,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69347da3 to 127.0.0.1:50021 2023-07-19 19:10:47,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:10:47,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x65d6dc9e to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:47,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f456ce2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:47,208 DEBUG [hconnection-0x32c5a229-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:47,211 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:47,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:47,219 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:47,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65d6dc9e to 127.0.0.1:50021 2023-07-19 19:10:47,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:10:47,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 19:10:47,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:10:47,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:47,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:47,226 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:47,227 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689794447227 2023-07-19 19:10:47,227 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 19:10:47,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:47,229 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:10:47,229 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:10:47,231 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:47,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:47,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-19 19:10:47,234 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:47,234 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689794447234 2023-07-19 19:10:47,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 19:10:47,250 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 19:10:47,250 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:47,251 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 19:10:47,251 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 19:10:47,251 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,251 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,253 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:47,253 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:47,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:47,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:47,253 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,253 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:47,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,253 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,254 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,254 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,254 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:10:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 19:10:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 19:10:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 19:10:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:47,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:47,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:47,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 19:10:47,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 19:10:47,255 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:47,255 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:47,255 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:47,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 19:10:47,256 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:47,256 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:47,256 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:47,255 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:47,257 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:47,256 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:47,258 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:47,258 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:47,258 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:47,258 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:47,258 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:47,258 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:47,261 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,261 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:47,265 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,265 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,265 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:47,265 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,265 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:47,265 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,265 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:47,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:47,265 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,265 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:47,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:47,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 19:10:47,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74750633[Count = 1] remaining members to acquire global barrier 2023-07-19 19:10:47,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:47,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:47,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:47,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 19:10:47,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74750633[Count = 0] remaining members to acquire global barrier 2023-07-19 19:10:47,271 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 19:10:47,271 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,275 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,275 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,275 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,275 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:47,275 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,275 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:47,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:10:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:47,276 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,276 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:10:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:10:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:10:47,276 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:47,276 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:10:47,276 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. started... 2023-07-19 19:10:47,276 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. started... 2023-07-19 19:10:47,276 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:10:47,276 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d0c37e2d488b0bc1fa450da19a208095 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 19:10:47,277 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 23139d5277aab311e937517f4da1327d 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 19:10:47,279 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:47,279 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:47,279 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:47,329 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:47,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:47,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:47,331 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:10:47,383 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/.tmp/cf/0f6f9e17b78443b897e32f6ac4b7e951 2023-07-19 19:10:47,384 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/.tmp/cf/3b820fb3633b40c690fd20219517910b 2023-07-19 19:10:47,451 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/.tmp/cf/3b820fb3633b40c690fd20219517910b as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/cf/3b820fb3633b40c690fd20219517910b 2023-07-19 19:10:47,451 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/.tmp/cf/0f6f9e17b78443b897e32f6ac4b7e951 as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/cf/0f6f9e17b78443b897e32f6ac4b7e951 2023-07-19 19:10:47,463 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/cf/3b820fb3633b40c690fd20219517910b, entries=46, sequenceid=6, filesize=7.9 K 2023-07-19 19:10:47,463 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/cf/0f6f9e17b78443b897e32f6ac4b7e951, entries=4, sequenceid=6, filesize=5.1 K 2023-07-19 19:10:47,469 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for d0c37e2d488b0bc1fa450da19a208095 in 193ms, sequenceid=6, compaction requested=false 2023-07-19 19:10:47,469 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 19:10:47,469 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 23139d5277aab311e937517f4da1327d in 193ms, sequenceid=6, compaction requested=false 2023-07-19 19:10:47,469 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 19:10:47,472 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0c37e2d488b0bc1fa450da19a208095: 2023-07-19 19:10:47,472 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 23139d5277aab311e937517f4da1327d: 2023-07-19 19:10:47,472 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 19:10:47,472 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 19:10:47,472 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:10:47,473 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:10:47,473 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/cf/0f6f9e17b78443b897e32f6ac4b7e951] hfiles 2023-07-19 19:10:47,473 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/cf/3b820fb3633b40c690fd20219517910b] hfiles 2023-07-19 19:10:47,473 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/cf/0f6f9e17b78443b897e32f6ac4b7e951 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 19:10:47,473 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/cf/3b820fb3633b40c690fd20219517910b for snapshot=snaptb0-testExportWithTargetName 2023-07-19 19:10:47,512 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. completed. 2023-07-19 19:10:47,512 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:10:47,512 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:10:47,512 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:10:47,512 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,512 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:47,512 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:10:47,514 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. completed. 2023-07-19 19:10:47,514 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:10:47,514 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:10:47,514 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:10:47,514 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,515 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:47,515 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:10:47,516 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,516 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,516 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:47,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:47,516 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:47,518 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:47,518 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:47,518 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:47,518 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:47,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:47,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39767,1689793835630': 2023-07-19 19:10:47,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 19:10:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:47,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:47,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:47,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,531 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:47,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:47,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:47,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,533 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:10:47,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39881,1689793835575': 2023-07-19 19:10:47,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 19:10:47,534 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 19:10:47,534 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:10:47,534 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:10:47,534 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 19:10:47,534 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:10:47,536 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,536 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,536 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,536 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:47,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,536 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:47,536 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,537 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:47,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:47,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:47,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:47,538 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,539 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:47,539 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:47,543 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,544 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,544 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:47,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:47,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:47,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:47,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:47,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:47,559 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:47,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:47,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:47,559 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,561 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:10:47,561 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,561 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:10:47,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:47,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:47,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:47,561 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:10:47,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:47,562 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,562 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 19:10:47,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,646 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689793847227Consolidate snapshot: snaptb0-testExportWithTargetName at 1689793847559 (+332 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689793847559Writing data manifest for snaptb0-testExportWithTargetName at 1689793847569 (+10 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689793847586 (+17 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689793847645 (+59 ms) 2023-07-19 19:10:47,648 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:47,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 420 msec 2023-07-19 19:10:47,833 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:47,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:47,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:10:47,838 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838 2023-07-19 19:10:47,838 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39651, tgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838, rawTgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838, srcFsUri=hdfs://localhost:39651, srcDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:10:47,879 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:10:47,880 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1575840288_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 19:10:47,880 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7, snapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 19:10:47,898 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 19:10:48,363 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,364 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,364 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,365 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,365 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,366 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,366 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,450 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop-8047149287558465416.jar 2023-07-19 19:10:48,450 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,451 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,451 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,452 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,452 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,453 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:48,454 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:10:48,454 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:10:48,455 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:10:48,456 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:10:48,456 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:10:48,457 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:10:48,458 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:10:48,458 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:10:48,459 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:10:48,459 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:10:48,463 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:10:48,463 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:10:48,464 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:10:48,464 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:10:48,464 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:10:48,465 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:10:48,465 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:10:49,318 WARN [Listener at jenkins-hbase4.apache.org/41077] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:10:49,324 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 19:10:49,332 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 19:10:49,851 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:10:49,853 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:10:50,322 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0001_000001 (auth:SIMPLE) 2023-07-19 19:10:51,298 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:10:55,495 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0001_000001 (auth:SIMPLE) 2023-07-19 19:10:57,802 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0001_000001 (auth:SIMPLE) 2023-07-19 19:11:01,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0001_000001 (auth:SIMPLE) 2023-07-19 19:11:03,261 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:11:03,263 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:11:03,274 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 19:11:03,275 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:11:03,275 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:11:03,276 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 19:11:03,276 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 19:11:03,276 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 19:11:03,277 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838/.hbase-snapshot/testExportWithTargetName 2023-07-19 19:11:03,277 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 19:11:03,277 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793847838/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 19:11:03,289 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 19:11:03,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 19:11:03,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:03,309 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793863309"}]},"ts":"1689793863309"} 2023-07-19 19:11:03,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 19:11:03,311 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 19:11:03,313 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 19:11:03,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0c37e2d488b0bc1fa450da19a208095, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=23139d5277aab311e937517f4da1327d, UNASSIGN}] 2023-07-19 19:11:03,318 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0c37e2d488b0bc1fa450da19a208095, UNASSIGN 2023-07-19 19:11:03,318 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=23139d5277aab311e937517f4da1327d, UNASSIGN 2023-07-19 19:11:03,319 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=23139d5277aab311e937517f4da1327d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:03,319 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=d0c37e2d488b0bc1fa450da19a208095, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:03,320 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793863319"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793863319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793863319"}]},"ts":"1689793863319"} 2023-07-19 19:11:03,320 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793863319"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793863319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793863319"}]},"ts":"1689793863319"} 2023-07-19 19:11:03,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure d0c37e2d488b0bc1fa450da19a208095, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:11:03,323 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 23139d5277aab311e937517f4da1327d, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:11:03,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 19:11:03,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:11:03,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 23139d5277aab311e937517f4da1327d 2023-07-19 19:11:03,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d0c37e2d488b0bc1fa450da19a208095, disabling compactions & flushes 2023-07-19 19:11:03,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 23139d5277aab311e937517f4da1327d, disabling compactions & flushes 2023-07-19 19:11:03,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:11:03,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:11:03,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:11:03,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:11:03,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. after waiting 0 ms 2023-07-19 19:11:03,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. after waiting 0 ms 2023-07-19 19:11:03,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:11:03,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:11:03,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:03,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:03,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:03,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:03,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095. 2023-07-19 19:11:03,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d. 2023-07-19 19:11:03,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d0c37e2d488b0bc1fa450da19a208095: 2023-07-19 19:11:03,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 23139d5277aab311e937517f4da1327d: 2023-07-19 19:11:03,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 23139d5277aab311e937517f4da1327d 2023-07-19 19:11:03,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:11:03,515 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=23139d5277aab311e937517f4da1327d, regionState=CLOSED 2023-07-19 19:11:03,515 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793863515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793863515"}]},"ts":"1689793863515"} 2023-07-19 19:11:03,516 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=d0c37e2d488b0bc1fa450da19a208095, regionState=CLOSED 2023-07-19 19:11:03,516 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793863516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793863516"}]},"ts":"1689793863516"} 2023-07-19 19:11:03,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-19 19:11:03,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 23139d5277aab311e937517f4da1327d, server=jenkins-hbase4.apache.org,39767,1689793835630 in 194 msec 2023-07-19 19:11:03,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-19 19:11:03,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure d0c37e2d488b0bc1fa450da19a208095, server=jenkins-hbase4.apache.org,39881,1689793835575 in 197 msec 2023-07-19 19:11:03,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=23139d5277aab311e937517f4da1327d, UNASSIGN in 207 msec 2023-07-19 19:11:03,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-19 19:11:03,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d0c37e2d488b0bc1fa450da19a208095, UNASSIGN in 208 msec 2023-07-19 19:11:03,529 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793863529"}]},"ts":"1689793863529"} 2023-07-19 19:11:03,531 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 19:11:03,533 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 19:11:03,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 238 msec 2023-07-19 19:11:03,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 19:11:03,614 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 19:11:03,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 19:11:03,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:03,632 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:03,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 19:11:03,635 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:03,638 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 19:11:03,642 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 19:11:03,642 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 19:11:03,642 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 19:11:03,642 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 19:11:03,644 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:03,644 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:03,644 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:03,644 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:03,647 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:11:03,648 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d 2023-07-19 19:11:03,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 19:11:03,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 19:11:03,648 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:03,650 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 19:11:03,650 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 19:11:03,650 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:03,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 19:11:03,651 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:03,650 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:03,652 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/recovered.edits] 2023-07-19 19:11:03,652 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/recovered.edits] 2023-07-19 19:11:03,664 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/cf/3b820fb3633b40c690fd20219517910b to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/cf/3b820fb3633b40c690fd20219517910b 2023-07-19 19:11:03,664 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/cf/0f6f9e17b78443b897e32f6ac4b7e951 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/cf/0f6f9e17b78443b897e32f6ac4b7e951 2023-07-19 19:11:03,668 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095/recovered.edits/9.seqid 2023-07-19 19:11:03,669 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d/recovered.edits/9.seqid 2023-07-19 19:11:03,669 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/d0c37e2d488b0bc1fa450da19a208095 2023-07-19 19:11:03,670 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportWithTargetName/23139d5277aab311e937517f4da1327d 2023-07-19 19:11:03,670 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 19:11:03,673 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:03,695 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 19:11:03,699 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 19:11:03,701 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:03,701 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 19:11:03,701 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793863701"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:03,701 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793863701"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:03,704 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:11:03,704 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d0c37e2d488b0bc1fa450da19a208095, NAME => 'testtb-testExportWithTargetName,,1689793845262.d0c37e2d488b0bc1fa450da19a208095.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 23139d5277aab311e937517f4da1327d, NAME => 'testtb-testExportWithTargetName,1,1689793845262.23139d5277aab311e937517f4da1327d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:11:03,705 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 19:11:03,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793863705"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:03,707 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 19:11:03,710 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:03,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 89 msec 2023-07-19 19:11:03,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 19:11:03,750 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 19:11:03,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 19:11:03,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 19:11:03,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 19:11:03,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 19:11:03,839 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=758 (was 710) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:33768 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:37831 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:40289 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:59176 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-193309559_1 at /127.0.0.1:59618 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:33985 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=934 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=476 (was 377) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=2457 (was 4768) 2023-07-19 19:11:03,840 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-19 19:11:03,868 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=758, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=476, ProcessCount=184, AvailableMemoryMB=2443 2023-07-19 19:11:03,868 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-19 19:11:03,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:11:03,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:03,877 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:11:03,878 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 19:11:03,879 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:11:03,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 19:11:03,882 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:03,882 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:03,882 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01 empty. 2023-07-19 19:11:03,882 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481 empty. 2023-07-19 19:11:03,883 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:03,883 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:03,883 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 19:11:03,899 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 19:11:03,901 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b79f9ab536ec51290dc6a3289464dd01, NAME => 'testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:11:03,901 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 669c6526981f519790aca7d9cca5e481, NAME => 'testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:11:03,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:03,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b79f9ab536ec51290dc6a3289464dd01, disabling compactions & flushes 2023-07-19 19:11:03,961 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:03,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:03,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. after waiting 0 ms 2023-07-19 19:11:03,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:03,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:03,963 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 669c6526981f519790aca7d9cca5e481, disabling compactions & flushes 2023-07-19 19:11:03,963 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:03,963 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:03,963 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b79f9ab536ec51290dc6a3289464dd01: 2023-07-19 19:11:03,963 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:03,963 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. after waiting 0 ms 2023-07-19 19:11:03,963 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:03,963 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:03,963 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 669c6526981f519790aca7d9cca5e481: 2023-07-19 19:11:03,967 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:11:03,968 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793863967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793863967"}]},"ts":"1689793863967"} 2023-07-19 19:11:03,968 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793863967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793863967"}]},"ts":"1689793863967"} 2023-07-19 19:11:03,971 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:11:03,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:11:03,973 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793863973"}]},"ts":"1689793863973"} 2023-07-19 19:11:03,975 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 19:11:03,980 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:11:03,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 19:11:03,981 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:11:03,981 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:11:03,981 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:11:03,981 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:11:03,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b79f9ab536ec51290dc6a3289464dd01, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=669c6526981f519790aca7d9cca5e481, ASSIGN}] 2023-07-19 19:11:03,986 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=669c6526981f519790aca7d9cca5e481, ASSIGN 2023-07-19 19:11:03,986 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b79f9ab536ec51290dc6a3289464dd01, ASSIGN 2023-07-19 19:11:03,987 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b79f9ab536ec51290dc6a3289464dd01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39881,1689793835575; forceNewPlan=false, retain=false 2023-07-19 19:11:03,987 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=669c6526981f519790aca7d9cca5e481, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37775,1689793835515; forceNewPlan=false, retain=false 2023-07-19 19:11:04,137 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:11:04,141 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b79f9ab536ec51290dc6a3289464dd01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,141 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=669c6526981f519790aca7d9cca5e481, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,141 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793864141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793864141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793864141"}]},"ts":"1689793864141"} 2023-07-19 19:11:04,141 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793864141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793864141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793864141"}]},"ts":"1689793864141"} 2023-07-19 19:11:04,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure b79f9ab536ec51290dc6a3289464dd01, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:11:04,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 669c6526981f519790aca7d9cca5e481, server=jenkins-hbase4.apache.org,37775,1689793835515}] 2023-07-19 19:11:04,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 19:11:04,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:04,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b79f9ab536ec51290dc6a3289464dd01, NAME => 'testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:11:04,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. service=AccessControlService 2023-07-19 19:11:04,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:04,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:04,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:04,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:04,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 669c6526981f519790aca7d9cca5e481, NAME => 'testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:11:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. service=AccessControlService 2023-07-19 19:11:04,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:04,308 INFO [StoreOpener-b79f9ab536ec51290dc6a3289464dd01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:04,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:04,310 INFO [StoreOpener-669c6526981f519790aca7d9cca5e481-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:04,310 DEBUG [StoreOpener-b79f9ab536ec51290dc6a3289464dd01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/cf 2023-07-19 19:11:04,310 DEBUG [StoreOpener-b79f9ab536ec51290dc6a3289464dd01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/cf 2023-07-19 19:11:04,311 INFO [StoreOpener-b79f9ab536ec51290dc6a3289464dd01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b79f9ab536ec51290dc6a3289464dd01 columnFamilyName cf 2023-07-19 19:11:04,311 DEBUG [StoreOpener-669c6526981f519790aca7d9cca5e481-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/cf 2023-07-19 19:11:04,311 INFO [StoreOpener-b79f9ab536ec51290dc6a3289464dd01-1] regionserver.HStore(310): Store=b79f9ab536ec51290dc6a3289464dd01/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:04,311 DEBUG [StoreOpener-669c6526981f519790aca7d9cca5e481-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/cf 2023-07-19 19:11:04,314 INFO [StoreOpener-669c6526981f519790aca7d9cca5e481-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 669c6526981f519790aca7d9cca5e481 columnFamilyName cf 2023-07-19 19:11:04,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:04,314 INFO [StoreOpener-669c6526981f519790aca7d9cca5e481-1] regionserver.HStore(310): Store=669c6526981f519790aca7d9cca5e481/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:04,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:04,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:04,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:04,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:04,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:04,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:04,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b79f9ab536ec51290dc6a3289464dd01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64175823, jitterRate=-0.043705716729164124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b79f9ab536ec51290dc6a3289464dd01: 2023-07-19 19:11:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:04,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 669c6526981f519790aca7d9cca5e481; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62263679, jitterRate=-0.07219888269901276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:04,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 669c6526981f519790aca7d9cca5e481: 2023-07-19 19:11:04,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01., pid=30, masterSystemTime=1689793864297 2023-07-19 19:11:04,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481., pid=31, masterSystemTime=1689793864298 2023-07-19 19:11:04,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:04,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:04,327 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b79f9ab536ec51290dc6a3289464dd01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:04,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:04,328 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793864327"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793864327"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793864327"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793864327"}]},"ts":"1689793864327"} 2023-07-19 19:11:04,328 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=669c6526981f519790aca7d9cca5e481, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,328 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793864328"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793864328"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793864328"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793864328"}]},"ts":"1689793864328"} 2023-07-19 19:11:04,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-19 19:11:04,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure b79f9ab536ec51290dc6a3289464dd01, server=jenkins-hbase4.apache.org,39881,1689793835575 in 185 msec 2023-07-19 19:11:04,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-19 19:11:04,339 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 669c6526981f519790aca7d9cca5e481, server=jenkins-hbase4.apache.org,37775,1689793835515 in 186 msec 2023-07-19 19:11:04,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b79f9ab536ec51290dc6a3289464dd01, ASSIGN in 353 msec 2023-07-19 19:11:04,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-19 19:11:04,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=669c6526981f519790aca7d9cca5e481, ASSIGN in 357 msec 2023-07-19 19:11:04,346 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:11:04,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793864346"}]},"ts":"1689793864346"} 2023-07-19 19:11:04,349 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 19:11:04,356 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:11:04,356 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 19:11:04,359 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:11:04,361 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:04,361 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:04,361 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:04,361 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:04,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:04,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:04,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:04,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:04,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 492 msec 2023-07-19 19:11:04,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 19:11:04,484 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 19:11:04,484 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 19:11:04,484 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:04,488 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 19:11:04,489 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:04,489 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-19 19:11:04,492 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:04,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793864492 (current time:1689793864492). 2023-07-19 19:11:04,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:04,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x164bf672 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:04,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26fc0825, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:04,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:04,502 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:04,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x164bf672 to 127.0.0.1:50021 2023-07-19 19:11:04,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:04,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x778e2611 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:04,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e3fa6f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:04,515 DEBUG [hconnection-0x78c42c36-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:04,519 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:04,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:04,525 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:04,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x778e2611 to 127.0.0.1:50021 2023-07-19 19:11:04,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:04,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:11:04,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:04,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:04,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:04,532 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:04,533 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689794464533 2023-07-19 19:11:04,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 19:11:04,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:04,535 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:04,535 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:04,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:04,537 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:04,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-19 19:11:04,540 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:04,541 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689794464541 2023-07-19 19:11:04,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,556 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 19:11:04,556 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:04,558 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 19:11:04,558 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 19:11:04,558 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,558 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,560 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:04,560 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:04,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:04,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:04,560 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,560 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:04,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:04,560 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,560 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,561 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,561 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 19:11:04,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,562 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:04,562 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:04,562 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:04,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,562 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:04,562 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:04,562 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:04,562 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:04,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:04,564 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:04,566 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:04,572 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,572 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,573 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:04,573 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:04,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 19:11:04,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b44355[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:04,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:04,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 19:11:04,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b44355[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:04,578 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 19:11:04,578 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,580 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,580 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,580 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:04,580 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:04,580 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:11:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,581 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:04,581 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:04,581 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:04,581 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. started... 2023-07-19 19:11:04,581 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,581 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:04,581 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:04,583 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b79f9ab536ec51290dc6a3289464dd01: 2023-07-19 19:11:04,583 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:04,583 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:04,583 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,583 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:04,583 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:04,583 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. started... 2023-07-19 19:11:04,583 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:04,584 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 669c6526981f519790aca7d9cca5e481: 2023-07-19 19:11:04,585 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:04,585 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:04,585 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,585 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:04,586 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:04,586 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:04,617 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. completed. 2023-07-19 19:11:04,617 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:04,617 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:04,617 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:04,617 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,617 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:04,618 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:11:04,621 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,621 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:04,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:04,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:04,621 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:04,622 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,628 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. completed. 2023-07-19 19:11:04,628 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:04,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:04,628 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:04,629 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:04,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,629 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,629 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:04,629 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:11:04,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,631 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,631 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:04,631 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:04,631 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:04,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39881,1689793835575': 2023-07-19 19:11:04,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 19:11:04,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:04,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:04,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:04,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:04,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,635 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:04,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:04,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:04,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,637 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:04,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:04,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37775,1689793835515': 2023-07-19 19:11:04,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 19:11:04,640 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 19:11:04,640 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:04,640 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:04,640 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,640 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:04,642 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,642 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:04,642 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,642 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:04,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:04,643 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,643 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:04,642 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:04,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:04,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:04,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:04,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:04,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:04,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:04,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:04,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,644 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,645 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:04,645 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:04,647 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,648 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,648 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,651 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,651 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:04,651 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:04,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:04,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:04,651 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:04,651 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:04,651 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:04,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:04,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:04,652 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,651 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:04,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:04,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,652 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,652 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:04,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:04,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:04,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:04,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:04,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:04,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 19:11:04,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,711 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:04,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689793864533Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689793864652 (+119 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689793864652Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689793864659 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689793864669 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689793864711 (+42 ms) 2023-07-19 19:11:04,714 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:04,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 179 msec 2023-07-19 19:11:04,838 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:04,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:04,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:04,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39881] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:04,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37775] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:04,861 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 19:11:04,861 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:04,862 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:04,883 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:04,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793864883 (current time:1689793864883). 2023-07-19 19:11:04,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:04,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x69f78217 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:04,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59a67d8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:04,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:04,895 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:04,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69f78217 to 127.0.0.1:50021 2023-07-19 19:11:04,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:04,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x42f26c9d to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:04,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7de0ec97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:04,907 DEBUG [hconnection-0x1c685062-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:04,908 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:04,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:04,917 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:04,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42f26c9d to 127.0.0.1:50021 2023-07-19 19:11:04,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:04,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:11:04,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:04,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:04,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:04,923 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:04,924 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689794464924 2023-07-19 19:11:04,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 19:11:04,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:04,926 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:04,926 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:04,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:04,927 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:04,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-19 19:11:04,931 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:04,934 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689794464934 2023-07-19 19:11:04,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 19:11:04,953 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 19:11:04,953 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:04,954 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 19:11:04,954 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 19:11:05,015 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,015 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,026 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:05,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:05,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:05,028 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:05,122 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,122 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:05,122 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:05,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:05,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:05,122 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:05,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:05,123 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,123 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,124 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,124 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:05,124 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:05,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 19:11:05,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 19:11:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:05,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 19:11:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:05,125 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:05,128 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:05,127 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:05,222 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,222 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,222 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,222 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,223 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:05,223 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,223 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,223 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:05,223 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:05,223 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,223 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:05,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:05,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:05,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 19:11:05,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fac918e[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:05,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:05,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:05,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:05,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:05,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:05,228 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:05,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:05,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:05,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:05,229 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:11:05,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 19:11:05,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fac918e[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:05,230 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 19:11:05,230 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,354 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:05,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,354 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:05,355 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:05,355 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. started... 2023-07-19 19:11:05,355 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:05,355 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. started... 2023-07-19 19:11:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:11:05,355 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:05,355 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,355 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b79f9ab536ec51290dc6a3289464dd01 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 19:11:05,355 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:05,355 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 669c6526981f519790aca7d9cca5e481 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 19:11:05,373 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/.tmp/cf/283e52c698494cb0b50fe7c461812830 2023-07-19 19:11:05,374 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/.tmp/cf/921a0f8320324f0bb36dd95ee688b94e 2023-07-19 19:11:05,384 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/.tmp/cf/283e52c698494cb0b50fe7c461812830 as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/cf/283e52c698494cb0b50fe7c461812830 2023-07-19 19:11:05,385 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/.tmp/cf/921a0f8320324f0bb36dd95ee688b94e as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/cf/921a0f8320324f0bb36dd95ee688b94e 2023-07-19 19:11:05,391 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/cf/283e52c698494cb0b50fe7c461812830, entries=4, sequenceid=6, filesize=5.1 K 2023-07-19 19:11:05,393 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b79f9ab536ec51290dc6a3289464dd01 in 38ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:05,393 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 19:11:05,393 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/cf/921a0f8320324f0bb36dd95ee688b94e, entries=46, sequenceid=6, filesize=7.9 K 2023-07-19 19:11:05,395 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b79f9ab536ec51290dc6a3289464dd01: 2023-07-19 19:11:05,395 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 19:11:05,395 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:05,396 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/cf/283e52c698494cb0b50fe7c461812830] hfiles 2023-07-19 19:11:05,396 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/cf/283e52c698494cb0b50fe7c461812830 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 19:11:05,396 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 669c6526981f519790aca7d9cca5e481 in 41ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:05,397 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 669c6526981f519790aca7d9cca5e481: 2023-07-19 19:11:05,397 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 19:11:05,397 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:05,398 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/cf/921a0f8320324f0bb36dd95ee688b94e] hfiles 2023-07-19 19:11:05,398 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/cf/921a0f8320324f0bb36dd95ee688b94e for snapshot=snaptb0-testExportFileSystemState 2023-07-19 19:11:05,414 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. completed. 2023-07-19 19:11:05,414 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:05,414 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. completed. 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:05,414 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:05,414 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:11:05,438 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:05,438 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:05,438 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:05,530 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:05,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:05,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:05,531 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 19:11:05,572 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:05,572 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:05,572 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:05,572 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,572 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:05,572 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:05,574 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,574 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39881,1689793835575': 2023-07-19 19:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 19:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:05,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37775,1689793835515': 2023-07-19 19:11:05,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 19:11:05,585 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 19:11:05,585 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:05,585 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:05,585 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 19:11:05,585 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:05,630 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,630 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,630 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,630 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,630 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:05,630 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:05,630 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:05,631 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:05,632 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,632 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:05,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:05,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,634 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:05,634 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:05,635 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:05,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:05,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:05,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,723 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:05,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:05,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:05,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:05,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:05,723 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:05,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:05,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:05,723 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 19:11:05,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:05,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 19:11:05,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:05,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:05,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:05,726 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,726 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,725 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:05,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:05,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:05,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:05,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:05,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:05,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:05,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 19:11:05,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,795 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:05,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689793864925Consolidate snapshot: snaptb0-testExportFileSystemState at 1689793865725 (+800 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689793865725Writing data manifest for snaptb0-testExportFileSystemState at 1689793865731 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689793865752 (+21 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689793865794 (+42 ms) 2023-07-19 19:11:05,798 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:05,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 872 msec 2023-07-19 19:11:06,031 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:06,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:06,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:06,037 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037 2023-07-19 19:11:06,037 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39651, tgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037, rawTgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037, srcFsUri=hdfs://localhost:39651, srcDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:11:06,069 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:11:06,069 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_430985815_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:06,069 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7, snapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 19:11:06,085 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:06,115 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,115 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,116 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,117 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,195 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop-3197962047125510170.jar 2023-07-19 19:11:06,196 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,197 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,197 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,197 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,198 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,198 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:06,199 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:11:06,199 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:11:06,200 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:11:06,200 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:11:06,200 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:11:06,201 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:11:06,201 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:11:06,202 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:11:06,202 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:11:06,203 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:11:06,203 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:06,204 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:06,204 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:06,204 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:06,205 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:06,205 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:06,205 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:06,636 WARN [Listener at jenkins-hbase4.apache.org/41077] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:11:06,638 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 19:11:06,641 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 19:11:07,604 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:07,604 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:07,613 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0001_000001 (auth:SIMPLE) 2023-07-19 19:11:08,346 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:09,140 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:11:12,873 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:15,157 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:17,839 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:19,868 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:11:19,869 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:11:19,878 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 19:11:19,878 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:11:19,879 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:11:19,879 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 19:11:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 19:11:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 19:11:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 19:11:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 19:11:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793866037/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 19:11:19,889 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 19:11:19,890 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 19:11:19,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:19,896 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793879896"}]},"ts":"1689793879896"} 2023-07-19 19:11:19,898 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 19:11:19,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 19:11:19,900 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 19:11:19,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b79f9ab536ec51290dc6a3289464dd01, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=669c6526981f519790aca7d9cca5e481, UNASSIGN}] 2023-07-19 19:11:19,904 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=669c6526981f519790aca7d9cca5e481, UNASSIGN 2023-07-19 19:11:19,904 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b79f9ab536ec51290dc6a3289464dd01, UNASSIGN 2023-07-19 19:11:19,905 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=669c6526981f519790aca7d9cca5e481, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:19,905 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b79f9ab536ec51290dc6a3289464dd01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:19,905 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793879905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793879905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793879905"}]},"ts":"1689793879905"} 2023-07-19 19:11:19,905 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793879905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793879905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793879905"}]},"ts":"1689793879905"} 2023-07-19 19:11:19,907 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure b79f9ab536ec51290dc6a3289464dd01, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:11:19,908 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 669c6526981f519790aca7d9cca5e481, server=jenkins-hbase4.apache.org,37775,1689793835515}] 2023-07-19 19:11:20,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 19:11:20,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:20,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b79f9ab536ec51290dc6a3289464dd01, disabling compactions & flushes 2023-07-19 19:11:20,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:20,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:20,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. after waiting 0 ms 2023-07-19 19:11:20,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:20,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:20,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 669c6526981f519790aca7d9cca5e481, disabling compactions & flushes 2023-07-19 19:11:20,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:20,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:20,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. after waiting 0 ms 2023-07-19 19:11:20,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:20,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:20,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:20,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01. 2023-07-19 19:11:20,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b79f9ab536ec51290dc6a3289464dd01: 2023-07-19 19:11:20,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:20,105 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b79f9ab536ec51290dc6a3289464dd01, regionState=CLOSED 2023-07-19 19:11:20,106 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793880105"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793880105"}]},"ts":"1689793880105"} 2023-07-19 19:11:20,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-19 19:11:20,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure b79f9ab536ec51290dc6a3289464dd01, server=jenkins-hbase4.apache.org,39881,1689793835575 in 201 msec 2023-07-19 19:11:20,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:20,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b79f9ab536ec51290dc6a3289464dd01, UNASSIGN in 212 msec 2023-07-19 19:11:20,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:20,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481. 2023-07-19 19:11:20,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 669c6526981f519790aca7d9cca5e481: 2023-07-19 19:11:20,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:20,119 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=669c6526981f519790aca7d9cca5e481, regionState=CLOSED 2023-07-19 19:11:20,119 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793880119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793880119"}]},"ts":"1689793880119"} 2023-07-19 19:11:20,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-19 19:11:20,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 669c6526981f519790aca7d9cca5e481, server=jenkins-hbase4.apache.org,37775,1689793835515 in 214 msec 2023-07-19 19:11:20,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-19 19:11:20,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=669c6526981f519790aca7d9cca5e481, UNASSIGN in 225 msec 2023-07-19 19:11:20,129 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793880129"}]},"ts":"1689793880129"} 2023-07-19 19:11:20,131 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 19:11:20,133 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 19:11:20,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 244 msec 2023-07-19 19:11:20,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 19:11:20,202 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 19:11:20,203 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 19:11:20,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:20,207 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:20,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 19:11:20,208 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:20,210 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 19:11:20,214 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:20,214 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:20,214 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:20,214 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:20,214 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:20,214 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:20,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 19:11:20,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 19:11:20,216 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:20,216 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:20,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-19 19:11:20,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-19 19:11:20,216 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:20,216 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:20,217 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:20,216 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:20,217 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:20,217 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/recovered.edits] 2023-07-19 19:11:20,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 19:11:20,216 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:20,217 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/recovered.edits] 2023-07-19 19:11:20,222 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/cf/921a0f8320324f0bb36dd95ee688b94e to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/cf/921a0f8320324f0bb36dd95ee688b94e 2023-07-19 19:11:20,223 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/cf/283e52c698494cb0b50fe7c461812830 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/cf/283e52c698494cb0b50fe7c461812830 2023-07-19 19:11:20,226 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481/recovered.edits/9.seqid 2023-07-19 19:11:20,227 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/669c6526981f519790aca7d9cca5e481 2023-07-19 19:11:20,227 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01/recovered.edits/9.seqid 2023-07-19 19:11:20,227 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemState/b79f9ab536ec51290dc6a3289464dd01 2023-07-19 19:11:20,227 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 19:11:20,232 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:20,235 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 19:11:20,237 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 19:11:20,239 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:20,239 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 19:11:20,239 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793880239"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:20,239 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793880239"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:20,241 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:11:20,242 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b79f9ab536ec51290dc6a3289464dd01, NAME => 'testtb-testExportFileSystemState,,1689793863870.b79f9ab536ec51290dc6a3289464dd01.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 669c6526981f519790aca7d9cca5e481, NAME => 'testtb-testExportFileSystemState,1,1689793863870.669c6526981f519790aca7d9cca5e481.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:11:20,242 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 19:11:20,242 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793880242"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:20,244 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 19:11:20,246 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:20,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-07-19 19:11:20,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 19:11:20,319 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 19:11:20,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 19:11:20,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:20,338 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 19:11:20,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 19:11:20,372 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=769 (was 758) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:33826 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1786849285_1 at /127.0.0.1:45668 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:41688 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2065 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1786849285_1 at /127.0.0.1:41644 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:45698 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:42141 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=446 (was 476), ProcessCount=185 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=2450 (was 2443) - AvailableMemoryMB LEAK? - 2023-07-19 19:11:20,372 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-19 19:11:20,398 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=769, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=446, ProcessCount=185, AvailableMemoryMB=2409 2023-07-19 19:11:20,398 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-19 19:11:20,400 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:11:20,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:20,405 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:11:20,405 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 19:11:20,406 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:11:20,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 19:11:20,409 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:20,409 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:20,410 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35 empty. 2023-07-19 19:11:20,410 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea empty. 2023-07-19 19:11:20,410 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:20,410 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:20,410 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 19:11:20,430 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 19:11:20,437 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => aa4ff5043e5188f57f7cdd0403d9eb35, NAME => 'testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:11:20,437 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 20d905110f47e3829b25b110c3c317ea, NAME => 'testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:11:20,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 19:11:20,529 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:20,529 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing aa4ff5043e5188f57f7cdd0403d9eb35, disabling compactions & flushes 2023-07-19 19:11:20,529 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:20,529 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:20,529 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. after waiting 0 ms 2023-07-19 19:11:20,529 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:20,529 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:20,529 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for aa4ff5043e5188f57f7cdd0403d9eb35: 2023-07-19 19:11:20,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 19:11:20,928 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:20,928 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 20d905110f47e3829b25b110c3c317ea, disabling compactions & flushes 2023-07-19 19:11:20,928 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:20,928 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:20,928 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. after waiting 0 ms 2023-07-19 19:11:20,928 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:20,928 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:20,928 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 20d905110f47e3829b25b110c3c317ea: 2023-07-19 19:11:20,931 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:11:20,932 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793880932"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793880932"}]},"ts":"1689793880932"} 2023-07-19 19:11:20,932 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793880932"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793880932"}]},"ts":"1689793880932"} 2023-07-19 19:11:20,935 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:11:20,936 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:11:20,936 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793880936"}]},"ts":"1689793880936"} 2023-07-19 19:11:20,937 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 19:11:20,946 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:11:20,947 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:11:20,947 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:11:20,947 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:11:20,947 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:11:20,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aa4ff5043e5188f57f7cdd0403d9eb35, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=20d905110f47e3829b25b110c3c317ea, ASSIGN}] 2023-07-19 19:11:20,951 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aa4ff5043e5188f57f7cdd0403d9eb35, ASSIGN 2023-07-19 19:11:20,951 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=20d905110f47e3829b25b110c3c317ea, ASSIGN 2023-07-19 19:11:20,952 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aa4ff5043e5188f57f7cdd0403d9eb35, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37775,1689793835515; forceNewPlan=false, retain=false 2023-07-19 19:11:20,952 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=20d905110f47e3829b25b110c3c317ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39767,1689793835630; forceNewPlan=false, retain=false 2023-07-19 19:11:21,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 19:11:21,102 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:11:21,105 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=aa4ff5043e5188f57f7cdd0403d9eb35, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,105 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=20d905110f47e3829b25b110c3c317ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,105 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793881105"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793881105"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793881105"}]},"ts":"1689793881105"} 2023-07-19 19:11:21,105 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793881105"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793881105"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793881105"}]},"ts":"1689793881105"} 2023-07-19 19:11:21,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure aa4ff5043e5188f57f7cdd0403d9eb35, server=jenkins-hbase4.apache.org,37775,1689793835515}] 2023-07-19 19:11:21,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 20d905110f47e3829b25b110c3c317ea, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:11:21,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:21,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa4ff5043e5188f57f7cdd0403d9eb35, NAME => 'testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:11:21,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. service=AccessControlService 2023-07-19 19:11:21,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:21,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:21,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:21,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:21,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:21,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:21,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20d905110f47e3829b25b110c3c317ea, NAME => 'testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:11:21,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. service=AccessControlService 2023-07-19 19:11:21,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:21,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:21,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:21,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:21,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:21,268 INFO [StoreOpener-aa4ff5043e5188f57f7cdd0403d9eb35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:21,268 INFO [StoreOpener-20d905110f47e3829b25b110c3c317ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:21,269 DEBUG [StoreOpener-aa4ff5043e5188f57f7cdd0403d9eb35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/cf 2023-07-19 19:11:21,269 DEBUG [StoreOpener-aa4ff5043e5188f57f7cdd0403d9eb35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/cf 2023-07-19 19:11:21,270 INFO [StoreOpener-aa4ff5043e5188f57f7cdd0403d9eb35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa4ff5043e5188f57f7cdd0403d9eb35 columnFamilyName cf 2023-07-19 19:11:21,270 DEBUG [StoreOpener-20d905110f47e3829b25b110c3c317ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/cf 2023-07-19 19:11:21,270 DEBUG [StoreOpener-20d905110f47e3829b25b110c3c317ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/cf 2023-07-19 19:11:21,270 INFO [StoreOpener-aa4ff5043e5188f57f7cdd0403d9eb35-1] regionserver.HStore(310): Store=aa4ff5043e5188f57f7cdd0403d9eb35/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:21,270 INFO [StoreOpener-20d905110f47e3829b25b110c3c317ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20d905110f47e3829b25b110c3c317ea columnFamilyName cf 2023-07-19 19:11:21,271 INFO [StoreOpener-20d905110f47e3829b25b110c3c317ea-1] regionserver.HStore(310): Store=20d905110f47e3829b25b110c3c317ea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:21,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:21,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:21,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:21,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:21,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:21,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:21,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aa4ff5043e5188f57f7cdd0403d9eb35; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73605810, jitterRate=0.09681203961372375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:21,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aa4ff5043e5188f57f7cdd0403d9eb35: 2023-07-19 19:11:21,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 20d905110f47e3829b25b110c3c317ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73916483, jitterRate=0.10144142806529999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:21,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 20d905110f47e3829b25b110c3c317ea: 2023-07-19 19:11:21,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35., pid=45, masterSystemTime=1689793881259 2023-07-19 19:11:21,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea., pid=46, masterSystemTime=1689793881260 2023-07-19 19:11:21,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:21,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:21,281 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=aa4ff5043e5188f57f7cdd0403d9eb35, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:21,281 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793881281"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793881281"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793881281"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793881281"}]},"ts":"1689793881281"} 2023-07-19 19:11:21,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:21,282 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=20d905110f47e3829b25b110c3c317ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,282 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793881282"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793881282"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793881282"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793881282"}]},"ts":"1689793881282"} 2023-07-19 19:11:21,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-19 19:11:21,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure aa4ff5043e5188f57f7cdd0403d9eb35, server=jenkins-hbase4.apache.org,37775,1689793835515 in 176 msec 2023-07-19 19:11:21,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-19 19:11:21,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 20d905110f47e3829b25b110c3c317ea, server=jenkins-hbase4.apache.org,39767,1689793835630 in 177 msec 2023-07-19 19:11:21,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aa4ff5043e5188f57f7cdd0403d9eb35, ASSIGN in 337 msec 2023-07-19 19:11:21,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-19 19:11:21,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=20d905110f47e3829b25b110c3c317ea, ASSIGN in 339 msec 2023-07-19 19:11:21,290 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:11:21,290 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793881290"}]},"ts":"1689793881290"} 2023-07-19 19:11:21,291 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 19:11:21,294 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:11:21,294 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 19:11:21,296 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 19:11:21,298 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:21,298 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:21,298 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:21,298 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:21,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:21,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:21,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:21,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:21,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 899 msec 2023-07-19 19:11:21,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 19:11:21,513 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 19:11:21,513 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-19 19:11:21,513 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:21,516 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-19 19:11:21,516 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:21,516 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-19 19:11:21,519 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:21,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793881519 (current time:1689793881519). 2023-07-19 19:11:21,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:21,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x1c36f801 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:21,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d8764f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:21,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:21,532 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:21,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c36f801 to 127.0.0.1:50021 2023-07-19 19:11:21,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:21,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x12b6f630 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:21,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39ebf297, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:21,540 DEBUG [hconnection-0x78c081eb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:21,542 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:21,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:21,549 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:21,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12b6f630 to 127.0.0.1:50021 2023-07-19 19:11:21,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:21,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 19:11:21,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:21,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:21,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:21,554 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:21,555 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689794481555 2023-07-19 19:11:21,555 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 19:11:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:21,556 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:21,556 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:21,557 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:21,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:21,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-19 19:11:21,560 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:21,560 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689794481560 2023-07-19 19:11:21,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,574 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 19:11:21,574 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:21,576 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 19:11:21,576 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 19:11:21,576 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,576 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,578 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,578 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:21,578 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:21,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:21,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:21,578 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:21,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:21,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:21,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:21,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:21,579 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,579 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,579 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,579 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:21,580 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:21,580 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:21,580 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:21,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:21,586 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:21,587 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:21,587 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,588 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:21,589 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:21,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 19:11:21,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@204bec2[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:21,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 19:11:21,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@204bec2[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:21,594 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 19:11:21,594 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:21,595 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,595 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:21,595 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:11:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:21,596 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:21,596 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. started... 2023-07-19 19:11:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:21,596 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:21,596 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,597 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. started... 2023-07-19 19:11:21,597 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:21,597 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20d905110f47e3829b25b110c3c317ea: 2023-07-19 19:11:21,598 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aa4ff5043e5188f57f7cdd0403d9eb35: 2023-07-19 19:11:21,599 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,599 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,599 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:21,599 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:21,600 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:21,600 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:21,605 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:21,605 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:21,605 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:21,617 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. completed. 2023-07-19 19:11:21,617 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. completed. 2023-07-19 19:11:21,617 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:21,617 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:11:21,617 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:11:21,619 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:21,619 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:21,619 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,619 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:21,619 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:21,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:21,619 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:21,619 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:21,621 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:21,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:21,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:21,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:21,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37775,1689793835515': 2023-07-19 19:11:21,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 19:11:21,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:21,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:21,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:21,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:21,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:21,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39767,1689793835630': 2023-07-19 19:11:21,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 19:11:21,630 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 19:11:21,630 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:21,630 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:21,630 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,630 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:21,632 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,632 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,632 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:21,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:21,632 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:21,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,632 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:21,632 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,633 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:21,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:21,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:21,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:21,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:21,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:21,636 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,638 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:21,639 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,640 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:21,641 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,641 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,645 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,645 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,645 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:21,645 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,646 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:21,646 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:21,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:21,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:21,646 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:21,646 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:21,646 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,648 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:21,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:21,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:21,648 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:21,646 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,648 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,648 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,648 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,648 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,648 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,648 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:21,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:21,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:21,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:21,656 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:21,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 19:11:21,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:21,658 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:21,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 19:11:21,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,700 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:21,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689793881555Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689793881648 (+93 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689793881648Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689793881652 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689793881669 (+17 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689793881699 (+30 ms) 2023-07-19 19:11:21,705 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:21,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 149 msec 2023-07-19 19:11:21,858 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:21,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 19:11:21,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:21,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37775] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:21,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39767] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:21,872 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 19:11:21,872 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:21,874 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:21,886 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:21,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793881886 (current time:1689793881886). 2023-07-19 19:11:21,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:21,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x1d1845df to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:21,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ba0579a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:21,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:21,902 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:21,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d1845df to 127.0.0.1:50021 2023-07-19 19:11:21,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:21,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x3fd705e5 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:21,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60be997d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:21,912 DEBUG [hconnection-0x397b1e77-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:21,915 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:21,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:21,920 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:21,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fd705e5 to 127.0.0.1:50021 2023-07-19 19:11:21,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:21,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 19:11:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:21,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:21,930 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:21,931 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689794481931 2023-07-19 19:11:21,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:21,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 19:11:21,932 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:21,933 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:21,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:21,934 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:21,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-19 19:11:21,937 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:21,937 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689794481937 2023-07-19 19:11:21,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 19:11:21,949 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 19:11:21,950 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:21,951 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 19:11:21,951 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 19:11:21,952 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,952 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,954 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:21,954 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:21,954 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:21,954 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:21,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:21,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:21,954 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,954 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:21,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,955 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,955 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:21,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 19:11:21,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,956 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 19:11:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 19:11:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,956 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 19:11:21,956 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:21,956 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:21,956 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:21,956 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:21,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 19:11:21,958 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:21,958 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:21,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 19:11:21,958 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:21,958 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:21,958 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:21,958 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:21,960 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:21,961 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:21,958 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:21,961 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:21,961 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:21,961 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:21,961 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:21,963 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,963 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:21,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:21,964 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,964 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,964 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:21,964 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,964 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:21,964 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,964 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:21,964 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,964 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:21,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:21,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 19:11:21,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22dcadb4[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:21,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:21,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:21,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:21,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:21,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:21,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:21,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:21,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 19:11:21,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22dcadb4[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:21,969 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 19:11:21,970 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:21,971 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:21,971 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:21,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:21,971 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:11:21,971 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:21,972 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:21,972 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:21,972 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:21,972 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:21,972 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:21,972 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:21,972 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:21,972 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:21,972 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. started... 2023-07-19 19:11:21,972 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:21,972 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. started... 2023-07-19 19:11:21,972 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 20d905110f47e3829b25b110c3c317ea 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 19:11:21,973 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing aa4ff5043e5188f57f7cdd0403d9eb35 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 19:11:21,974 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:21,974 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:21,974 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:21,990 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/.tmp/cf/aa5da833c9a14f38be699370e1d8a951 2023-07-19 19:11:21,990 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/.tmp/cf/32f8d8b81e6f476292766c03f2636a3f 2023-07-19 19:11:21,998 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/.tmp/cf/32f8d8b81e6f476292766c03f2636a3f as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/cf/32f8d8b81e6f476292766c03f2636a3f 2023-07-19 19:11:21,998 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/.tmp/cf/aa5da833c9a14f38be699370e1d8a951 as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/cf/aa5da833c9a14f38be699370e1d8a951 2023-07-19 19:11:22,003 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/cf/32f8d8b81e6f476292766c03f2636a3f, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 19:11:22,004 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/cf/aa5da833c9a14f38be699370e1d8a951, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 19:11:22,004 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for aa4ff5043e5188f57f7cdd0403d9eb35 in 31ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:22,004 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 20d905110f47e3829b25b110c3c317ea in 32ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:22,005 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 19:11:22,005 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 19:11:22,006 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aa4ff5043e5188f57f7cdd0403d9eb35: 2023-07-19 19:11:22,006 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20d905110f47e3829b25b110c3c317ea: 2023-07-19 19:11:22,010 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 19:11:22,010 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 19:11:22,010 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:22,010 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:22,011 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/cf/32f8d8b81e6f476292766c03f2636a3f] hfiles 2023-07-19 19:11:22,011 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/cf/aa5da833c9a14f38be699370e1d8a951] hfiles 2023-07-19 19:11:22,011 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/cf/aa5da833c9a14f38be699370e1d8a951 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 19:11:22,011 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/cf/32f8d8b81e6f476292766c03f2636a3f for snapshot=snaptb0-testConsecutiveExports 2023-07-19 19:11:22,020 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. completed. 2023-07-19 19:11:22,020 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:22,020 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:22,020 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:22,020 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,020 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:22,020 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:11:22,022 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:22,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:22,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:22,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:22,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:22,024 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. completed. 2023-07-19 19:11:22,024 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:22,024 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:22,024 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:22,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:22,024 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,025 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:22,025 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:11:22,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:22,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,026 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:22,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:22,027 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:22,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:22,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:22,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39767,1689793835630': 2023-07-19 19:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 19:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:22,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:22,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,033 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:22,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37775,1689793835515': 2023-07-19 19:11:22,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 19:11:22,033 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 19:11:22,033 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:22,033 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:22,033 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 19:11:22,033 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:22,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 19:11:22,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:22,034 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:22,035 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,035 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,035 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,035 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:22,035 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:22,035 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:22,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,036 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,035 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:22,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:22,036 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,037 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:22,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,039 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,039 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:22,040 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:22,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:22,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:22,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:22,048 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:22,048 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:22,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,050 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,050 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:22,050 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,050 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:22,050 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:22,050 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,050 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,048 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 19:11:22,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:22,048 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:22,048 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:22,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:22,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:22,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:22,050 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:22,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:22,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 19:11:22,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:22,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:22,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:22,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:22,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:22,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:22,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 19:11:22,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,096 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689793881931Consolidate snapshot: snaptb0-testConsecutiveExports at 1689793882050 (+119 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689793882051 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689793882055 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689793882068 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689793882096 (+28 ms) 2023-07-19 19:11:22,099 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:22,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 167 msec 2023-07-19 19:11:22,234 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:22,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 19:11:22,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:22,236 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236 2023-07-19 19:11:22,237 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236, srcFsUri=hdfs://localhost:39651, srcDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:11:22,260 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:11:22,260 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@32c80ad8, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,260 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7, snapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 19:11:22,269 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:22,282 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,282 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,283 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,284 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,284 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,284 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,285 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,359 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop-1667535178366510828.jar 2023-07-19 19:11:22,360 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,360 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,361 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,361 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,362 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,362 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:22,363 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:11:22,363 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:11:22,364 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:11:22,365 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:11:22,365 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:11:22,366 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:11:22,366 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:11:22,367 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:11:22,367 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:11:22,368 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:11:22,369 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:22,369 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:22,370 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:22,370 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:22,370 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:22,371 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:22,372 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:22,843 WARN [Listener at jenkins-hbase4.apache.org/41077] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:11:22,846 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 19:11:22,848 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 19:11:24,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:24,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:24,023 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:24,618 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:25,692 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:11:28,665 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:30,944 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:34,217 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:36,054 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:11:36,055 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:11:36,059 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 19:11:36,060 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:11:36,060 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:11:36,061 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:36,063 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 19:11:36,063 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 19:11:36,064 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@58b86ef1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:36,064 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 19:11:36,064 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 19:11:36,066 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236, srcFsUri=hdfs://localhost:39651, srcDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:11:36,096 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:11:36,096 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@76ac863d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:36,096 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7, snapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 19:11:36,118 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:36,138 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,139 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,139 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,140 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,140 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,141 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,141 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,240 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop-6278578704773354869.jar 2023-07-19 19:11:36,241 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,242 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,242 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,243 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,243 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,244 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:36,244 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:11:36,246 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:11:36,247 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:11:36,247 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:11:36,248 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:11:36,248 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:11:36,249 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:11:36,249 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:11:36,250 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:11:36,251 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:11:36,251 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:36,252 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:36,252 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:36,253 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:36,253 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:36,254 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:36,254 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:36,800 WARN [Listener at jenkins-hbase4.apache.org/41077] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:11:36,803 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 19:11:36,806 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 19:11:40,394 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:40,394 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:40,397 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:41,171 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0004_000001 (auth:SIMPLE) 2023-07-19 19:11:45,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0004_000001 (auth:SIMPLE) 2023-07-19 19:11:47,467 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0004_000001 (auth:SIMPLE) 2023-07-19 19:11:53,059 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:11:53,059 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:11:53,064 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 19:11:53,064 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:11:53,065 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:11:53,065 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:53,068 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 19:11:53,068 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 19:11:53,068 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@58b86ef1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:53,068 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 19:11:53,068 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/local-export-1689793882236/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 19:11:53,081 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 19:11:53,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 19:11:53,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:53,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 19:11:53,087 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793913087"}]},"ts":"1689793913087"} 2023-07-19 19:11:53,091 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 19:11:53,093 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 19:11:53,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aa4ff5043e5188f57f7cdd0403d9eb35, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=20d905110f47e3829b25b110c3c317ea, UNASSIGN}] 2023-07-19 19:11:53,097 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aa4ff5043e5188f57f7cdd0403d9eb35, UNASSIGN 2023-07-19 19:11:53,097 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=20d905110f47e3829b25b110c3c317ea, UNASSIGN 2023-07-19 19:11:53,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=20d905110f47e3829b25b110c3c317ea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:53,098 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=aa4ff5043e5188f57f7cdd0403d9eb35, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:53,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793913098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793913098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793913098"}]},"ts":"1689793913098"} 2023-07-19 19:11:53,098 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793913098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793913098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793913098"}]},"ts":"1689793913098"} 2023-07-19 19:11:53,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 20d905110f47e3829b25b110c3c317ea, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:11:53,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure aa4ff5043e5188f57f7cdd0403d9eb35, server=jenkins-hbase4.apache.org,37775,1689793835515}] 2023-07-19 19:11:53,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 19:11:53,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:53,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:53,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 20d905110f47e3829b25b110c3c317ea, disabling compactions & flushes 2023-07-19 19:11:53,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aa4ff5043e5188f57f7cdd0403d9eb35, disabling compactions & flushes 2023-07-19 19:11:53,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:53,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:53,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:53,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:53,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. after waiting 0 ms 2023-07-19 19:11:53,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. after waiting 0 ms 2023-07-19 19:11:53,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:53,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:53,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:53,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:53,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:53,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:53,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35. 2023-07-19 19:11:53,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea. 2023-07-19 19:11:53,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aa4ff5043e5188f57f7cdd0403d9eb35: 2023-07-19 19:11:53,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 20d905110f47e3829b25b110c3c317ea: 2023-07-19 19:11:53,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:53,358 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=aa4ff5043e5188f57f7cdd0403d9eb35, regionState=CLOSED 2023-07-19 19:11:53,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:53,358 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793913358"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793913358"}]},"ts":"1689793913358"} 2023-07-19 19:11:53,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 19:11:53,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure aa4ff5043e5188f57f7cdd0403d9eb35, server=jenkins-hbase4.apache.org,37775,1689793835515 in 259 msec 2023-07-19 19:11:53,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=aa4ff5043e5188f57f7cdd0403d9eb35, UNASSIGN in 269 msec 2023-07-19 19:11:53,364 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=20d905110f47e3829b25b110c3c317ea, regionState=CLOSED 2023-07-19 19:11:53,364 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793913364"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793913364"}]},"ts":"1689793913364"} 2023-07-19 19:11:53,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 19:11:53,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 20d905110f47e3829b25b110c3c317ea, server=jenkins-hbase4.apache.org,39767,1689793835630 in 266 msec 2023-07-19 19:11:53,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-19 19:11:53,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=20d905110f47e3829b25b110c3c317ea, UNASSIGN in 276 msec 2023-07-19 19:11:53,371 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793913371"}]},"ts":"1689793913371"} 2023-07-19 19:11:53,374 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 19:11:53,376 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 19:11:53,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 295 msec 2023-07-19 19:11:53,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 19:11:53,391 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 19:11:53,392 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 19:11:53,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:53,396 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:53,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 19:11:53,397 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:53,400 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 19:11:53,407 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:53,407 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:53,407 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:53,407 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:53,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 19:11:53,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 19:11:53,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 19:11:53,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:53,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:53,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:53,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:53,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:53,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:53,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-19 19:11:53,410 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:53,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:53,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 19:11:53,426 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:53,433 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/recovered.edits] 2023-07-19 19:11:53,442 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:53,444 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/cf/32f8d8b81e6f476292766c03f2636a3f to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/cf/32f8d8b81e6f476292766c03f2636a3f 2023-07-19 19:11:53,446 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/recovered.edits] 2023-07-19 19:11:53,455 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35/recovered.edits/9.seqid 2023-07-19 19:11:53,456 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/aa4ff5043e5188f57f7cdd0403d9eb35 2023-07-19 19:11:53,457 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/cf/aa5da833c9a14f38be699370e1d8a951 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/cf/aa5da833c9a14f38be699370e1d8a951 2023-07-19 19:11:53,461 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea/recovered.edits/9.seqid 2023-07-19 19:11:53,461 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testConsecutiveExports/20d905110f47e3829b25b110c3c317ea 2023-07-19 19:11:53,461 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 19:11:53,464 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:53,481 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 19:11:53,497 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 19:11:53,499 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:53,499 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 19:11:53,499 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793913499"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:53,499 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793913499"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:53,508 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:11:53,508 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aa4ff5043e5188f57f7cdd0403d9eb35, NAME => 'testtb-testConsecutiveExports,,1689793880400.aa4ff5043e5188f57f7cdd0403d9eb35.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 20d905110f47e3829b25b110c3c317ea, NAME => 'testtb-testConsecutiveExports,1,1689793880400.20d905110f47e3829b25b110c3c317ea.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:11:53,508 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 19:11:53,508 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793913508"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:53,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 19:11:53,526 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 19:11:53,530 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:53,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 138 msec 2023-07-19 19:11:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 19:11:53,714 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 19:11:53,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 19:11:53,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:53,740 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 19:11:53,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 19:11:53,805 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=751 (was 769), OpenFileDescriptor=910 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=370 (was 446), ProcessCount=187 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=2782 (was 2409) - AvailableMemoryMB LEAK? - 2023-07-19 19:11:53,806 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-19 19:11:53,831 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=370, ProcessCount=187, AvailableMemoryMB=2766 2023-07-19 19:11:53,832 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-19 19:11:53,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:11:53,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:53,837 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:11:53,838 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 19:11:53,838 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:11:53,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 19:11:53,842 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:11:53,842 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536 empty. 2023-07-19 19:11:53,843 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071 2023-07-19 19:11:53,843 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:11:53,843 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071 empty. 2023-07-19 19:11:53,844 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071 2023-07-19 19:11:53,844 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 19:11:53,891 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 19:11:53,911 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 41fb367440c6c9ee75f9a22bd187e536, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:11:53,918 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 906386064665ce7cf111ad8f47365071, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:11:53,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 19:11:54,012 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:54,012 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 906386064665ce7cf111ad8f47365071, disabling compactions & flushes 2023-07-19 19:11:54,012 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,012 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,012 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. after waiting 0 ms 2023-07-19 19:11:54,012 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,012 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,012 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 906386064665ce7cf111ad8f47365071: 2023-07-19 19:11:54,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:54,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 41fb367440c6c9ee75f9a22bd187e536, disabling compactions & flushes 2023-07-19 19:11:54,016 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. after waiting 0 ms 2023-07-19 19:11:54,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,016 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 41fb367440c6c9ee75f9a22bd187e536: 2023-07-19 19:11:54,021 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:11:54,023 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793914022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793914022"}]},"ts":"1689793914022"} 2023-07-19 19:11:54,023 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793914022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793914022"}]},"ts":"1689793914022"} 2023-07-19 19:11:54,048 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:11:54,049 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:11:54,050 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793914049"}]},"ts":"1689793914049"} 2023-07-19 19:11:54,051 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 19:11:54,056 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:11:54,057 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:11:54,058 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:11:54,058 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:11:54,058 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:11:54,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41fb367440c6c9ee75f9a22bd187e536, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=906386064665ce7cf111ad8f47365071, ASSIGN}] 2023-07-19 19:11:54,061 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=906386064665ce7cf111ad8f47365071, ASSIGN 2023-07-19 19:11:54,062 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41fb367440c6c9ee75f9a22bd187e536, ASSIGN 2023-07-19 19:11:54,063 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=906386064665ce7cf111ad8f47365071, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37775,1689793835515; forceNewPlan=false, retain=false 2023-07-19 19:11:54,063 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41fb367440c6c9ee75f9a22bd187e536, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39767,1689793835630; forceNewPlan=false, retain=false 2023-07-19 19:11:54,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 19:11:54,214 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:11:54,217 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=41fb367440c6c9ee75f9a22bd187e536, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,217 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=906386064665ce7cf111ad8f47365071, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,218 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793914217"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793914217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793914217"}]},"ts":"1689793914217"} 2023-07-19 19:11:54,218 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793914217"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793914217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793914217"}]},"ts":"1689793914217"} 2023-07-19 19:11:54,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 41fb367440c6c9ee75f9a22bd187e536, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:11:54,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 906386064665ce7cf111ad8f47365071, server=jenkins-hbase4.apache.org,37775,1689793835515}] 2023-07-19 19:11:54,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 906386064665ce7cf111ad8f47365071, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:11:54,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. service=AccessControlService 2023-07-19 19:11:54,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:54,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41fb367440c6c9ee75f9a22bd187e536, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:11:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 906386064665ce7cf111ad8f47365071 2023-07-19 19:11:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 906386064665ce7cf111ad8f47365071 2023-07-19 19:11:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. service=AccessControlService 2023-07-19 19:11:54,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:11:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:11:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:11:54,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 906386064665ce7cf111ad8f47365071 2023-07-19 19:11:54,391 INFO [StoreOpener-41fb367440c6c9ee75f9a22bd187e536-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:11:54,391 INFO [StoreOpener-906386064665ce7cf111ad8f47365071-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 906386064665ce7cf111ad8f47365071 2023-07-19 19:11:54,393 DEBUG [StoreOpener-41fb367440c6c9ee75f9a22bd187e536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/cf 2023-07-19 19:11:54,393 DEBUG [StoreOpener-41fb367440c6c9ee75f9a22bd187e536-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/cf 2023-07-19 19:11:54,397 DEBUG [StoreOpener-906386064665ce7cf111ad8f47365071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/cf 2023-07-19 19:11:54,397 DEBUG [StoreOpener-906386064665ce7cf111ad8f47365071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/cf 2023-07-19 19:11:54,398 INFO [StoreOpener-906386064665ce7cf111ad8f47365071-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 906386064665ce7cf111ad8f47365071 columnFamilyName cf 2023-07-19 19:11:54,398 INFO [StoreOpener-41fb367440c6c9ee75f9a22bd187e536-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41fb367440c6c9ee75f9a22bd187e536 columnFamilyName cf 2023-07-19 19:11:54,399 INFO [StoreOpener-41fb367440c6c9ee75f9a22bd187e536-1] regionserver.HStore(310): Store=41fb367440c6c9ee75f9a22bd187e536/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:54,399 INFO [StoreOpener-906386064665ce7cf111ad8f47365071-1] regionserver.HStore(310): Store=906386064665ce7cf111ad8f47365071/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:54,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071 2023-07-19 19:11:54,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:11:54,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071 2023-07-19 19:11:54,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:11:54,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 906386064665ce7cf111ad8f47365071 2023-07-19 19:11:54,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:11:54,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:54,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 906386064665ce7cf111ad8f47365071; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61956852, jitterRate=-0.07677096128463745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:54,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 906386064665ce7cf111ad8f47365071: 2023-07-19 19:11:54,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:54,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 41fb367440c6c9ee75f9a22bd187e536; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66886756, jitterRate=-0.0033096671104431152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:54,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 41fb367440c6c9ee75f9a22bd187e536: 2023-07-19 19:11:54,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071., pid=61, masterSystemTime=1689793914382 2023-07-19 19:11:54,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536., pid=60, masterSystemTime=1689793914382 2023-07-19 19:11:54,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,413 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=906386064665ce7cf111ad8f47365071, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,413 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793914413"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793914413"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793914413"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793914413"}]},"ts":"1689793914413"} 2023-07-19 19:11:54,415 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=41fb367440c6c9ee75f9a22bd187e536, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,415 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793914415"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793914415"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793914415"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793914415"}]},"ts":"1689793914415"} 2023-07-19 19:11:54,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-19 19:11:54,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 906386064665ce7cf111ad8f47365071, server=jenkins-hbase4.apache.org,37775,1689793835515 in 188 msec 2023-07-19 19:11:54,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-19 19:11:54,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 41fb367440c6c9ee75f9a22bd187e536, server=jenkins-hbase4.apache.org,39767,1689793835630 in 192 msec 2023-07-19 19:11:54,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=906386064665ce7cf111ad8f47365071, ASSIGN in 362 msec 2023-07-19 19:11:54,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-19 19:11:54,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41fb367440c6c9ee75f9a22bd187e536, ASSIGN in 366 msec 2023-07-19 19:11:54,428 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:11:54,428 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793914428"}]},"ts":"1689793914428"} 2023-07-19 19:11:54,431 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 19:11:54,436 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:11:54,437 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 19:11:54,439 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 19:11:54,441 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:54,441 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:54,441 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:54,441 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:54,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:54,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:54,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:54,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:54,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 610 msec 2023-07-19 19:11:54,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 19:11:54,449 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 19:11:54,449 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-19 19:11:54,449 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:54,464 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-19 19:11:54,464 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:54,464 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-19 19:11:54,471 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:54,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793914471 (current time:1689793914471). 2023-07-19 19:11:54,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:54,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x1e62511a to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:54,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49fb2c2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:54,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:54,519 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:54,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e62511a to 127.0.0.1:50021 2023-07-19 19:11:54,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:54,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x42860435 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:54,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ee067fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:54,533 DEBUG [hconnection-0x5e6a907d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:54,541 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:54,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:54,550 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:54,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42860435 to 127.0.0.1:50021 2023-07-19 19:11:54,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:54,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 19:11:54,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:54,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:54,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:54,556 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:54,559 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689794514559 2023-07-19 19:11:54,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:54,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:54,564 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:54,565 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:54,565 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:54,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-19 19:11:54,567 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:54,568 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689794514568 2023-07-19 19:11:54,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,614 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 19:11:54,614 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:54,616 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 19:11:54,616 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 19:11:54,617 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,617 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,619 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:54,619 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:54,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:54,619 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:54,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:54,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:54,619 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:54,620 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,620 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 19:11:54,622 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 19:11:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,622 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:54,623 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 19:11:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,623 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:54,623 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:54,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,645 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:54,646 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:54,645 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:54,648 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:54,648 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:54,650 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:54,645 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:54,650 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:54,650 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:54,649 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:54,652 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:54,652 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:54,651 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:54,652 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:54,652 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:54,654 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,654 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:54,655 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,655 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:54,656 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,656 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:54,656 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,656 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:54,656 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,657 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,657 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:54,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 19:11:54,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4393ec51[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:54,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:54,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 19:11:54,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4393ec51[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:54,661 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 19:11:54,662 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,663 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,663 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,663 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:54,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,664 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,664 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,664 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:54,664 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:54,664 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:11:54,665 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,665 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:54,665 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:54,665 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,665 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:54,665 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. started... 2023-07-19 19:11:54,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:54,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:54,667 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:54,669 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:54,669 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:54,669 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,669 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:54,669 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:54,670 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:54,674 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:54,674 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,674 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. started... 2023-07-19 19:11:54,672 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 906386064665ce7cf111ad8f47365071: 2023-07-19 19:11:54,676 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41fb367440c6c9ee75f9a22bd187e536: 2023-07-19 19:11:54,677 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,677 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,677 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:54,677 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:54,677 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:54,677 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:54,722 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. completed. 2023-07-19 19:11:54,722 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:11:54,724 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:54,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,728 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. completed. 2023-07-19 19:11:54,728 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:54,729 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:11:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,730 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:54,730 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:54,730 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:54,733 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37775,1689793835515': 2023-07-19 19:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 19:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39767,1689793835630': 2023-07-19 19:11:54,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 19:11:54,747 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 19:11:54,747 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:54,747 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:54,747 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,747 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:54,749 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,749 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:54,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,749 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:54,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:54,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:54,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:54,750 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,750 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:54,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,758 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:54,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,758 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:54,763 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,764 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:54,764 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:54,767 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,767 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,768 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,773 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:54,773 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:54,773 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:54,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:54,773 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:54,773 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:54,773 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:54,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:54,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:54,773 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:54,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:54,773 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,776 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,776 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,776 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,776 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,776 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,776 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,776 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,776 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,776 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,773 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:54,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:54,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:54,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:54,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:54,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:54,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:54,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:54,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 19:11:54,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,863 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689793914559Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689793914776 (+217 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689793914776Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689793914795 (+19 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689793914817 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689793914862 (+45 ms) 2023-07-19 19:11:54,866 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:54,867 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:54,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 305 msec 2023-07-19 19:11:54,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:54,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:54,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39767] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:54,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37775] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:54,882 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,882 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,884 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:54,900 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:54,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793914900 (current time:1689793914900). 2023-07-19 19:11:54,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:54,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x0e1625c4 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:54,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22479832, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:54,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:54,916 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:54,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e1625c4 to 127.0.0.1:50021 2023-07-19 19:11:54,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:54,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x7d8067d9 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:54,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@428745a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:54,928 DEBUG [hconnection-0x5c9fd3c2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:54,932 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:54,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:54,939 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:54,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d8067d9 to 127.0.0.1:50021 2023-07-19 19:11:54,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:54,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 19:11:54,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:54,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:54,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:54,947 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:54,948 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689794514948 2023-07-19 19:11:54,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:54,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,950 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:54,950 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:54,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:54,952 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:54,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-19 19:11:54,954 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:54,955 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689794514955 2023-07-19 19:11:54,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,969 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 19:11:54,969 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:54,971 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 19:11:54,971 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 19:11:54,971 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,972 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,973 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:54,973 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:54,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:54,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:54,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:54,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:54,973 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,973 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:54,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:54,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:54,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,974 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,974 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,974 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,974 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:54,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 19:11:54,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 19:11:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,975 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:54,975 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 19:11:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,975 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:54,975 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:54,975 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:54,975 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:54,977 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:54,977 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:54,975 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:54,977 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:54,979 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:54,979 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:54,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,979 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:54,979 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:54,979 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:54,980 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:54,980 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:54,980 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:54,982 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,982 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:54,983 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,983 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:54,984 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,984 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:54,984 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,985 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:54,984 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:54,985 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,985 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:54,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:54,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 19:11:54,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38c8354c[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:54,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 19:11:54,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38c8354c[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:54,989 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 19:11:54,989 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,990 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,990 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,990 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,991 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:54,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:54,991 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:54,991 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:11:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:54,991 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:54,991 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:54,991 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. started... 2023-07-19 19:11:54,991 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. started... 2023-07-19 19:11:54,992 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 41fb367440c6c9ee75f9a22bd187e536 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 19:11:54,992 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 906386064665ce7cf111ad8f47365071 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 19:11:54,993 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:54,993 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:54,993 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:55,024 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/.tmp/cf/b479b52a4320450693d64ed03388dc5b 2023-07-19 19:11:55,024 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/.tmp/cf/a981b4ada9314b0f9b32d3b4a3e0f4ea 2023-07-19 19:11:55,033 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/.tmp/cf/b479b52a4320450693d64ed03388dc5b as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/cf/b479b52a4320450693d64ed03388dc5b 2023-07-19 19:11:55,041 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/.tmp/cf/a981b4ada9314b0f9b32d3b4a3e0f4ea as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/cf/a981b4ada9314b0f9b32d3b4a3e0f4ea 2023-07-19 19:11:55,041 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/cf/b479b52a4320450693d64ed03388dc5b, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 19:11:55,042 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 906386064665ce7cf111ad8f47365071 in 50ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:55,042 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 19:11:55,043 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 906386064665ce7cf111ad8f47365071: 2023-07-19 19:11:55,043 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,043 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:55,043 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/cf/b479b52a4320450693d64ed03388dc5b] hfiles 2023-07-19 19:11:55,043 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/cf/b479b52a4320450693d64ed03388dc5b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,048 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/cf/a981b4ada9314b0f9b32d3b4a3e0f4ea, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 19:11:55,049 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 41fb367440c6c9ee75f9a22bd187e536 in 57ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:55,052 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:55,052 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41fb367440c6c9ee75f9a22bd187e536: 2023-07-19 19:11:55,052 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,053 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:55,053 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/cf/a981b4ada9314b0f9b32d3b4a3e0f4ea] hfiles 2023-07-19 19:11:55,053 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/cf/a981b4ada9314b0f9b32d3b4a3e0f4ea for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:55,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:55,054 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:55,070 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. completed. 2023-07-19 19:11:55,070 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:11:55,070 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:55,070 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:55,070 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,071 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:55,071 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:11:55,074 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. completed. 2023-07-19 19:11:55,074 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:11:55,074 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:55,074 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:55,074 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,074 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:55,074 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:55,074 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:11:55,074 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,074 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:55,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:55,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:55,074 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:55,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:55,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:55,082 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:55,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,086 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:55,086 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:55,087 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:55,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37775,1689793835515': 2023-07-19 19:11:55,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 19:11:55,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:55,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:55,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:55,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:55,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:55,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39767,1689793835630': 2023-07-19 19:11:55,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 19:11:55,094 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 19:11:55,094 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:55,094 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:55,094 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,094 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:55,099 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:55,099 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:55,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,099 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:55,100 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:55,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:55,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:55,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:55,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:55,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:55,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:55,101 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,101 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:55,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,104 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:55,104 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,105 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,107 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,108 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,108 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,108 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:55,108 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:55,108 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:55,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:55,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:55,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:55,108 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,108 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:55,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:55,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:55,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:55,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:55,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:55,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:55,111 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:55,111 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:55,111 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,111 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,111 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:55,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:55,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:55,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:55,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:55,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 19:11:55,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,187 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:55,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689793914949Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689793915110 (+161 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689793915110Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689793915117 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689793915138 (+21 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689793915186 (+48 ms) 2023-07-19 19:11:55,190 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:55,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 240 msec 2023-07-19 19:11:55,254 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:55,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:55,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:55,301 DEBUG [Listener at jenkins-hbase4.apache.org/41077] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:11:55,306 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:11:55,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37775] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 19:11:55,309 DEBUG [Listener at jenkins-hbase4.apache.org/41077] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:11:55,321 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:11:55,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39767] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 19:11:55,326 DEBUG [Listener at jenkins-hbase4.apache.org/41077] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:11:55,331 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:11:55,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39881] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 19:11:55,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:11:55,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:55,341 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:11:55,343 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 19:11:55,344 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:11:55,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 19:11:55,347 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:55,347 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387 2023-07-19 19:11:55,348 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6 empty. 2023-07-19 19:11:55,348 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387 empty. 2023-07-19 19:11:55,348 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:55,349 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387 2023-07-19 19:11:55,349 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 19:11:55,385 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 19:11:55,387 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 63baf18de54e7af0ddfd4f38760bd3d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:11:55,391 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 119f297328960138b3d8ea88c8070387, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:11:55,419 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:55,419 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 119f297328960138b3d8ea88c8070387, disabling compactions & flushes 2023-07-19 19:11:55,419 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:55,419 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:55,419 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. after waiting 0 ms 2023-07-19 19:11:55,419 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:55,419 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:55,419 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 119f297328960138b3d8ea88c8070387: 2023-07-19 19:11:55,422 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:55,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 63baf18de54e7af0ddfd4f38760bd3d6, disabling compactions & flushes 2023-07-19 19:11:55,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:55,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:55,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. after waiting 0 ms 2023-07-19 19:11:55,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:55,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:55,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 63baf18de54e7af0ddfd4f38760bd3d6: 2023-07-19 19:11:55,426 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:11:55,427 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793915427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793915427"}]},"ts":"1689793915427"} 2023-07-19 19:11:55,427 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793915427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793915427"}]},"ts":"1689793915427"} 2023-07-19 19:11:55,430 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:11:55,434 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:11:55,434 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793915434"}]},"ts":"1689793915434"} 2023-07-19 19:11:55,436 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 19:11:55,440 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:11:55,442 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:11:55,442 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:11:55,442 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:11:55,442 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:11:55,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63baf18de54e7af0ddfd4f38760bd3d6, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119f297328960138b3d8ea88c8070387, ASSIGN}] 2023-07-19 19:11:55,446 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119f297328960138b3d8ea88c8070387, ASSIGN 2023-07-19 19:11:55,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 19:11:55,447 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63baf18de54e7af0ddfd4f38760bd3d6, ASSIGN 2023-07-19 19:11:55,449 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63baf18de54e7af0ddfd4f38760bd3d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39881,1689793835575; forceNewPlan=false, retain=false 2023-07-19 19:11:55,449 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119f297328960138b3d8ea88c8070387, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39767,1689793835630; forceNewPlan=false, retain=false 2023-07-19 19:11:55,599 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:11:55,603 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=119f297328960138b3d8ea88c8070387, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,603 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=63baf18de54e7af0ddfd4f38760bd3d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,604 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793915603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793915603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793915603"}]},"ts":"1689793915603"} 2023-07-19 19:11:55,604 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793915603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793915603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793915603"}]},"ts":"1689793915603"} 2023-07-19 19:11:55,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 119f297328960138b3d8ea88c8070387, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:11:55,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 63baf18de54e7af0ddfd4f38760bd3d6, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:11:55,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 19:11:55,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:55,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 119f297328960138b3d8ea88c8070387, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 19:11:55,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. service=AccessControlService 2023-07-19 19:11:55,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:55,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:55,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 119f297328960138b3d8ea88c8070387 2023-07-19 19:11:55,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:55,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63baf18de54e7af0ddfd4f38760bd3d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 19:11:55,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 119f297328960138b3d8ea88c8070387 2023-07-19 19:11:55,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 119f297328960138b3d8ea88c8070387 2023-07-19 19:11:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. service=AccessControlService 2023-07-19 19:11:55,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:55,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:55,768 INFO [StoreOpener-119f297328960138b3d8ea88c8070387-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 119f297328960138b3d8ea88c8070387 2023-07-19 19:11:55,770 INFO [StoreOpener-63baf18de54e7af0ddfd4f38760bd3d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:55,770 DEBUG [StoreOpener-119f297328960138b3d8ea88c8070387-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/cf 2023-07-19 19:11:55,770 DEBUG [StoreOpener-119f297328960138b3d8ea88c8070387-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/cf 2023-07-19 19:11:55,771 INFO [StoreOpener-119f297328960138b3d8ea88c8070387-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 119f297328960138b3d8ea88c8070387 columnFamilyName cf 2023-07-19 19:11:55,771 DEBUG [StoreOpener-63baf18de54e7af0ddfd4f38760bd3d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/cf 2023-07-19 19:11:55,771 DEBUG [StoreOpener-63baf18de54e7af0ddfd4f38760bd3d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/cf 2023-07-19 19:11:55,772 INFO [StoreOpener-119f297328960138b3d8ea88c8070387-1] regionserver.HStore(310): Store=119f297328960138b3d8ea88c8070387/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:55,772 INFO [StoreOpener-63baf18de54e7af0ddfd4f38760bd3d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63baf18de54e7af0ddfd4f38760bd3d6 columnFamilyName cf 2023-07-19 19:11:55,772 INFO [StoreOpener-63baf18de54e7af0ddfd4f38760bd3d6-1] regionserver.HStore(310): Store=63baf18de54e7af0ddfd4f38760bd3d6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:55,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387 2023-07-19 19:11:55,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387 2023-07-19 19:11:55,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:55,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:55,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 119f297328960138b3d8ea88c8070387 2023-07-19 19:11:55,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:55,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 119f297328960138b3d8ea88c8070387; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70814845, jitterRate=0.05522342026233673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:55,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 119f297328960138b3d8ea88c8070387: 2023-07-19 19:11:55,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387., pid=69, masterSystemTime=1689793915758 2023-07-19 19:11:55,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:55,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:55,813 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=119f297328960138b3d8ea88c8070387, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:55,813 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793915813"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793915813"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793915813"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793915813"}]},"ts":"1689793915813"} 2023-07-19 19:11:55,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:55,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-19 19:11:55,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 119f297328960138b3d8ea88c8070387, server=jenkins-hbase4.apache.org,39767,1689793835630 in 210 msec 2023-07-19 19:11:55,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119f297328960138b3d8ea88c8070387, ASSIGN in 376 msec 2023-07-19 19:11:55,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:55,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 63baf18de54e7af0ddfd4f38760bd3d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72187342, jitterRate=0.07567521929740906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:55,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 63baf18de54e7af0ddfd4f38760bd3d6: 2023-07-19 19:11:55,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6., pid=70, masterSystemTime=1689793915759 2023-07-19 19:11:55,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:55,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:55,838 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=63baf18de54e7af0ddfd4f38760bd3d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:55,839 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793915838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793915838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793915838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793915838"}]},"ts":"1689793915838"} 2023-07-19 19:11:55,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-19 19:11:55,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 63baf18de54e7af0ddfd4f38760bd3d6, server=jenkins-hbase4.apache.org,39881,1689793835575 in 234 msec 2023-07-19 19:11:55,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-19 19:11:55,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63baf18de54e7af0ddfd4f38760bd3d6, ASSIGN in 402 msec 2023-07-19 19:11:55,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:11:55,856 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793915856"}]},"ts":"1689793915856"} 2023-07-19 19:11:55,863 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 19:11:55,867 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:11:55,867 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 19:11:55,870 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 19:11:55,873 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:55,873 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:55,873 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:55,873 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:55,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:55,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:55,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:55,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:55,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:55,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:55,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:55,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:55,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 539 msec 2023-07-19 19:11:55,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 19:11:55,951 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 19:11:55,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 63baf18de54e7af0ddfd4f38760bd3d6, 119f297328960138b3d8ea88c8070387 2023-07-19 19:11:56,016 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 19:11:56,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63baf18de54e7af0ddfd4f38760bd3d6, 119f297328960138b3d8ea88c8070387], force=true 2023-07-19 19:11:56,024 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63baf18de54e7af0ddfd4f38760bd3d6, 119f297328960138b3d8ea88c8070387], force=true 2023-07-19 19:11:56,024 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63baf18de54e7af0ddfd4f38760bd3d6, 119f297328960138b3d8ea88c8070387], force=true 2023-07-19 19:11:56,025 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63baf18de54e7af0ddfd4f38760bd3d6, 119f297328960138b3d8ea88c8070387], force=true 2023-07-19 19:11:56,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:11:56,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63baf18de54e7af0ddfd4f38760bd3d6, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119f297328960138b3d8ea88c8070387, UNASSIGN}] 2023-07-19 19:11:56,074 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63baf18de54e7af0ddfd4f38760bd3d6, UNASSIGN 2023-07-19 19:11:56,078 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119f297328960138b3d8ea88c8070387, UNASSIGN 2023-07-19 19:11:56,081 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=63baf18de54e7af0ddfd4f38760bd3d6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:56,081 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=119f297328960138b3d8ea88c8070387, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:56,082 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793916081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793916081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793916081"}]},"ts":"1689793916081"} 2023-07-19 19:11:56,082 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793916081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793916081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793916081"}]},"ts":"1689793916081"} 2023-07-19 19:11:56,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 63baf18de54e7af0ddfd4f38760bd3d6, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:11:56,084 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 119f297328960138b3d8ea88c8070387, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:11:56,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:11:56,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 119f297328960138b3d8ea88c8070387 2023-07-19 19:11:56,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:56,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 119f297328960138b3d8ea88c8070387, disabling compactions & flushes 2023-07-19 19:11:56,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 63baf18de54e7af0ddfd4f38760bd3d6, disabling compactions & flushes 2023-07-19 19:11:56,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:56,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:56,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:56,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:56,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. after waiting 0 ms 2023-07-19 19:11:56,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:56,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 119f297328960138b3d8ea88c8070387 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 19:11:56,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. after waiting 0 ms 2023-07-19 19:11:56,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:56,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 63baf18de54e7af0ddfd4f38760bd3d6 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 19:11:56,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/.tmp/cf/b4ce2ae19275447880eac8449adafd9b 2023-07-19 19:11:56,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/.tmp/cf/b4ce2ae19275447880eac8449adafd9b as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/cf/b4ce2ae19275447880eac8449adafd9b 2023-07-19 19:11:56,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/cf/b4ce2ae19275447880eac8449adafd9b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 19:11:56,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 119f297328960138b3d8ea88c8070387 in 45ms, sequenceid=5, compaction requested=false 2023-07-19 19:11:56,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/.tmp/cf/6b924b96e07841278a81de10307401b9 2023-07-19 19:11:56,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 19:11:56,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:56,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387. 2023-07-19 19:11:56,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 119f297328960138b3d8ea88c8070387: 2023-07-19 19:11:56,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 119f297328960138b3d8ea88c8070387 2023-07-19 19:11:56,310 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=119f297328960138b3d8ea88c8070387, regionState=CLOSED 2023-07-19 19:11:56,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/.tmp/cf/6b924b96e07841278a81de10307401b9 as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/cf/6b924b96e07841278a81de10307401b9 2023-07-19 19:11:56,310 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793916310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793916310"}]},"ts":"1689793916310"} 2023-07-19 19:11:56,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-19 19:11:56,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 119f297328960138b3d8ea88c8070387, server=jenkins-hbase4.apache.org,39767,1689793835630 in 228 msec 2023-07-19 19:11:56,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119f297328960138b3d8ea88c8070387, UNASSIGN in 245 msec 2023-07-19 19:11:56,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/cf/6b924b96e07841278a81de10307401b9, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 19:11:56,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 63baf18de54e7af0ddfd4f38760bd3d6 in 77ms, sequenceid=5, compaction requested=false 2023-07-19 19:11:56,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 19:11:56,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:56,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6. 2023-07-19 19:11:56,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 63baf18de54e7af0ddfd4f38760bd3d6: 2023-07-19 19:11:56,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:11:56,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:11:56,347 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=63baf18de54e7af0ddfd4f38760bd3d6, regionState=CLOSED 2023-07-19 19:11:56,347 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793916347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793916347"}]},"ts":"1689793916347"} 2023-07-19 19:11:56,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-19 19:11:56,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 63baf18de54e7af0ddfd4f38760bd3d6, server=jenkins-hbase4.apache.org,39881,1689793835575 in 267 msec 2023-07-19 19:11:56,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-19 19:11:56,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=63baf18de54e7af0ddfd4f38760bd3d6, UNASSIGN in 292 msec 2023-07-19 19:11:56,470 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 19:11:56,472 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915336.63baf18de54e7af0ddfd4f38760bd3d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:56,472 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793915336.119f297328960138b3d8ea88c8070387.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:56,473 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:56,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39e8015342b9d4fa84f78c0aeb86d807, ASSIGN}] 2023-07-19 19:11:56,533 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39e8015342b9d4fa84f78c0aeb86d807, ASSIGN 2023-07-19 19:11:56,539 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39e8015342b9d4fa84f78c0aeb86d807, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39881,1689793835575; forceNewPlan=false, retain=false 2023-07-19 19:11:56,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:11:56,689 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 19:11:56,692 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=39e8015342b9d4fa84f78c0aeb86d807, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:56,692 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689793916691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793916691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793916691"}]},"ts":"1689793916691"} 2023-07-19 19:11:56,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 39e8015342b9d4fa84f78c0aeb86d807, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:11:56,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. 2023-07-19 19:11:56,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39e8015342b9d4fa84f78c0aeb86d807, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:11:56,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. service=AccessControlService 2023-07-19 19:11:56,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:56,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:11:56,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:56,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:11:56,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:11:56,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/.regioninfo 2023-07-19 19:11:56,881 INFO [StoreOpener-39e8015342b9d4fa84f78c0aeb86d807-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:11:56,883 DEBUG [StoreOpener-39e8015342b9d4fa84f78c0aeb86d807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf 2023-07-19 19:11:56,883 DEBUG [StoreOpener-39e8015342b9d4fa84f78c0aeb86d807-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf 2023-07-19 19:11:56,885 INFO [StoreOpener-39e8015342b9d4fa84f78c0aeb86d807-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39e8015342b9d4fa84f78c0aeb86d807 columnFamilyName cf 2023-07-19 19:11:56,928 DEBUG [StoreOpener-39e8015342b9d4fa84f78c0aeb86d807-1] regionserver.HStore(539): loaded hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/6b924b96e07841278a81de10307401b9.63baf18de54e7af0ddfd4f38760bd3d6->hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/cf/6b924b96e07841278a81de10307401b9-top 2023-07-19 19:11:56,935 DEBUG [StoreOpener-39e8015342b9d4fa84f78c0aeb86d807-1] regionserver.HStore(539): loaded hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/b4ce2ae19275447880eac8449adafd9b.119f297328960138b3d8ea88c8070387->hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/cf/b4ce2ae19275447880eac8449adafd9b-top 2023-07-19 19:11:56,936 INFO [StoreOpener-39e8015342b9d4fa84f78c0aeb86d807-1] regionserver.HStore(310): Store=39e8015342b9d4fa84f78c0aeb86d807/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:56,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:11:56,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:11:56,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:11:56,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 39e8015342b9d4fa84f78c0aeb86d807; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66175889, jitterRate=-0.013902410864830017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:56,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 39e8015342b9d4fa84f78c0aeb86d807: 2023-07-19 19:11:56,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807., pid=77, masterSystemTime=1689793916847 2023-07-19 19:11:56,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.,because compaction is disabled. 2023-07-19 19:11:56,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. 2023-07-19 19:11:56,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. 2023-07-19 19:11:56,950 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=39e8015342b9d4fa84f78c0aeb86d807, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:56,950 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689793916949"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793916949"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793916949"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793916949"}]},"ts":"1689793916949"} 2023-07-19 19:11:56,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 19:11:56,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 39e8015342b9d4fa84f78c0aeb86d807, server=jenkins-hbase4.apache.org,39881,1689793835575 in 263 msec 2023-07-19 19:11:56,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 19:11:56,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39e8015342b9d4fa84f78c0aeb86d807, ASSIGN in 427 msec 2023-07-19 19:11:56,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[63baf18de54e7af0ddfd4f38760bd3d6, 119f297328960138b3d8ea88c8070387], force=true in 969 msec 2023-07-19 19:11:57,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:11:57,149 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 19:11:57,150 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 19:11:57,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793917150 (current time:1689793917150). 2023-07-19 19:11:57,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:57,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x4eb9088f to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:57,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74f47e85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:57,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:57,163 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:57,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4eb9088f to 127.0.0.1:50021 2023-07-19 19:11:57,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:57,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x437dcd53 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:57,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@450658c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:57,175 DEBUG [hconnection-0x125106b0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:57,178 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:57,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:57,185 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:57,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x437dcd53 to 127.0.0.1:50021 2023-07-19 19:11:57,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:57,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 19:11:57,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:57,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 19:11:57,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 19:11:57,192 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 19:11:57,194 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689794517194 2023-07-19 19:11:57,194 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 19:11:57,200 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:57,200 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:57,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 19:11:57,206 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 19:11:57,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 16 msec 2023-07-19 19:11:57,210 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 19:11:57,212 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689794517212 2023-07-19 19:11:57,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,232 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 19:11:57,233 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,234 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 19:11:57,234 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 19:11:57,235 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,235 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,236 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,237 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,237 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,237 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,238 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,238 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:57,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 19:11:57,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,239 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 19:11:57,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,240 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 19:11:57,240 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,241 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 19:11:57,241 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 19:11:57,241 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 19:11:57,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 19:11:57,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,243 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 19:11:57,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,243 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 19:11:57,243 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,245 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 19:11:57,245 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 19:11:57,245 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 19:11:57,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 19:11:57,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,245 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 19:11:57,246 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,246 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 19:11:57,246 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,247 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 19:11:57,248 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 19:11:57,248 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 19:11:57,254 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,255 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,255 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,257 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,257 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,257 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:57,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,258 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,258 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:57,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:57,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:57,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 19:11:57,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f9d7e39[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:57,260 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 19:11:57,260 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,261 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,261 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:57,261 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,261 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,261 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,262 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 19:11:57,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,262 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 19:11:57,262 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:11:57,262 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 19:11:57,262 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,262 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:57,262 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 19:11:57,263 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 19:11:57,263 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:11:57,263 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:57,263 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:57,263 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. 2023-07-19 19:11:57,263 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. started... 2023-07-19 19:11:57,266 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 39e8015342b9d4fa84f78c0aeb86d807: 2023-07-19 19:11:57,266 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,266 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:57,266 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/6b924b96e07841278a81de10307401b9.63baf18de54e7af0ddfd4f38760bd3d6->hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/cf/6b924b96e07841278a81de10307401b9-top, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/b4ce2ae19275447880eac8449adafd9b.119f297328960138b3d8ea88c8070387->hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/cf/b4ce2ae19275447880eac8449adafd9b-top] hfiles 2023-07-19 19:11:57,266 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/6b924b96e07841278a81de10307401b9.63baf18de54e7af0ddfd4f38760bd3d6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,267 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 19:11:57,267 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:57,267 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 19:11:57,268 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/b4ce2ae19275447880eac8449adafd9b.119f297328960138b3d8ea88c8070387 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,268 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 19:11:57,269 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:57,269 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 19:11:57,289 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. completed. 2023-07-19 19:11:57,289 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. 2023-07-19 19:11:57,289 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:57,289 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:57,289 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,289 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 19:11:57,289 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:11:57,294 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,294 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 19:11:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,294 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:57,294 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 19:11:57,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:57,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:57,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:57,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39881,1689793835575': 2023-07-19 19:11:57,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 19:11:57,298 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 19:11:57,299 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:57,299 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:57,299 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,299 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:57,300 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:57,301 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,301 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,301 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 19:11:57,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:57,302 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,302 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,302 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,302 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,302 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,303 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:57,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,305 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,306 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,310 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:57,310 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:57,310 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:57,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:57,315 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,315 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,316 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,316 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:57,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,316 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:11:57,319 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,327 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,327 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-19 19:11:57,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,502 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:57,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 19:11:57,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:57,505 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:11:57,538 WARN [DataStreamer for file /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-19 19:11:57,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 19:11:57,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,541 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689793917194Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689793917316 (+122 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689793917316Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689793917320 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689793917404 (+84 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689793917540 (+136 ms) 2023-07-19 19:11:57,548 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 19:11:57,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 349 msec 2023-07-19 19:11:57,578 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0004_000001 (auth:SIMPLE) 2023-07-19 19:11:57,806 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:57,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 19:11:57,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:57,807 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807 2023-07-19 19:11:57,807 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39651, tgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807, rawTgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807, srcFsUri=hdfs://localhost:39651, srcDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:11:57,833 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:11:57,833 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1147030687_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,833 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7, snapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 19:11:57,843 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:57,870 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,870 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,871 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,872 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,872 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,873 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,873 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,960 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop-6161312635604929034.jar 2023-07-19 19:11:57,961 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,962 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,962 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,963 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,963 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,964 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:57,964 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:11:57,965 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:11:57,965 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:11:57,966 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:11:57,966 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:11:57,967 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:11:57,967 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:11:57,968 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:11:57,968 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:11:57,969 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:11:57,969 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:57,970 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:57,970 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:57,970 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:57,971 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:57,971 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:57,972 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:58,518 WARN [Listener at jenkins-hbase4.apache.org/41077] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:11:58,520 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 19:11:58,523 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 19:11:58,929 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:11:59,002 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:59,002 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:59,590 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:04,909 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:07,262 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:11,419 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:13,241 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:12:13,247 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:12:13,285 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,286 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:12:13,286 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:12:13,287 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,287 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 19:12:13,287 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 19:12:13,288 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,288 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 19:12:13,288 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793917807/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 19:12:13,333 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,347 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793933347"}]},"ts":"1689793933347"} 2023-07-19 19:12:13,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 19:12:13,349 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 19:12:13,354 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 19:12:13,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39e8015342b9d4fa84f78c0aeb86d807, UNASSIGN}] 2023-07-19 19:12:13,357 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39e8015342b9d4fa84f78c0aeb86d807, UNASSIGN 2023-07-19 19:12:13,358 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=39e8015342b9d4fa84f78c0aeb86d807, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:13,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689793933358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793933358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793933358"}]},"ts":"1689793933358"} 2023-07-19 19:12:13,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 39e8015342b9d4fa84f78c0aeb86d807, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:12:13,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 19:12:13,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:12:13,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 39e8015342b9d4fa84f78c0aeb86d807, disabling compactions & flushes 2023-07-19 19:12:13,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. 2023-07-19 19:12:13,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. 2023-07-19 19:12:13,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. after waiting 0 ms 2023-07-19 19:12:13,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. 2023-07-19 19:12:13,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 19:12:13,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:13,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807. 2023-07-19 19:12:13,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 39e8015342b9d4fa84f78c0aeb86d807: 2023-07-19 19:12:13,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:12:13,536 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=39e8015342b9d4fa84f78c0aeb86d807, regionState=CLOSED 2023-07-19 19:12:13,537 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689793933536"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793933536"}]},"ts":"1689793933536"} 2023-07-19 19:12:13,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 19:12:13,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 39e8015342b9d4fa84f78c0aeb86d807, server=jenkins-hbase4.apache.org,39881,1689793835575 in 179 msec 2023-07-19 19:12:13,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 19:12:13,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39e8015342b9d4fa84f78c0aeb86d807, UNASSIGN in 186 msec 2023-07-19 19:12:13,546 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793933546"}]},"ts":"1689793933546"} 2023-07-19 19:12:13,548 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 19:12:13,550 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 19:12:13,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 218 msec 2023-07-19 19:12:13,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 19:12:13,652 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 19:12:13,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,658 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,659 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,660 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,667 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,667 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,667 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,668 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 19:12:13,668 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,668 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 19:12:13,668 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 19:12:13,668 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 19:12:13,670 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:12:13,673 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,673 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,673 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:13,673 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,674 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:13,673 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,674 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:13,673 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:13,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 19:12:13,677 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:13,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:13,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:13,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:13,679 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387 2023-07-19 19:12:13,679 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:12:13,683 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/recovered.edits] 2023-07-19 19:12:13,684 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/recovered.edits] 2023-07-19 19:12:13,686 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/recovered.edits] 2023-07-19 19:12:13,696 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/cf/b4ce2ae19275447880eac8449adafd9b to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/cf/b4ce2ae19275447880eac8449adafd9b 2023-07-19 19:12:13,697 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/6b924b96e07841278a81de10307401b9.63baf18de54e7af0ddfd4f38760bd3d6 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/6b924b96e07841278a81de10307401b9.63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:12:13,698 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/cf/6b924b96e07841278a81de10307401b9 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/cf/6b924b96e07841278a81de10307401b9 2023-07-19 19:12:13,705 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/b4ce2ae19275447880eac8449adafd9b.119f297328960138b3d8ea88c8070387 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/cf/b4ce2ae19275447880eac8449adafd9b.119f297328960138b3d8ea88c8070387 2023-07-19 19:12:13,711 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/recovered.edits/8.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387/recovered.edits/8.seqid 2023-07-19 19:12:13,712 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119f297328960138b3d8ea88c8070387 2023-07-19 19:12:13,713 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/recovered.edits/8.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6/recovered.edits/8.seqid 2023-07-19 19:12:13,714 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/63baf18de54e7af0ddfd4f38760bd3d6 2023-07-19 19:12:13,722 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/recovered.edits/12.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807/recovered.edits/12.seqid 2023-07-19 19:12:13,723 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39e8015342b9d4fa84f78c0aeb86d807 2023-07-19 19:12:13,723 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 19:12:13,727 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,743 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 19:12:13,750 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 19:12:13,753 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,753 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 19:12:13,754 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793933753"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:13,764 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 19:12:13,764 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 39e8015342b9d4fa84f78c0aeb86d807, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793915337.39e8015342b9d4fa84f78c0aeb86d807.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 19:12:13,764 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 19:12:13,764 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793933764"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:13,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 19:12:13,777 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 19:12:13,785 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:13,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 132 msec 2023-07-19 19:12:13,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 19:12:13,979 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 19:12:13,980 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:13,980 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:13,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:13,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 19:12:13,989 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793933989"}]},"ts":"1689793933989"} 2023-07-19 19:12:13,996 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 19:12:13,998 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 19:12:13,999 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41fb367440c6c9ee75f9a22bd187e536, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=906386064665ce7cf111ad8f47365071, UNASSIGN}] 2023-07-19 19:12:14,001 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41fb367440c6c9ee75f9a22bd187e536, UNASSIGN 2023-07-19 19:12:14,002 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=906386064665ce7cf111ad8f47365071, UNASSIGN 2023-07-19 19:12:14,003 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=41fb367440c6c9ee75f9a22bd187e536, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:14,003 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=906386064665ce7cf111ad8f47365071, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:14,003 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793934003"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793934003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793934003"}]},"ts":"1689793934003"} 2023-07-19 19:12:14,003 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793934003"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793934003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793934003"}]},"ts":"1689793934003"} 2023-07-19 19:12:14,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 41fb367440c6c9ee75f9a22bd187e536, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:12:14,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 906386064665ce7cf111ad8f47365071, server=jenkins-hbase4.apache.org,37775,1689793835515}] 2023-07-19 19:12:14,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 19:12:14,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:12:14,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 41fb367440c6c9ee75f9a22bd187e536, disabling compactions & flushes 2023-07-19 19:12:14,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:12:14,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:12:14,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. after waiting 0 ms 2023-07-19 19:12:14,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:12:14,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 906386064665ce7cf111ad8f47365071 2023-07-19 19:12:14,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 906386064665ce7cf111ad8f47365071, disabling compactions & flushes 2023-07-19 19:12:14,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:12:14,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:12:14,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. after waiting 0 ms 2023-07-19 19:12:14,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:12:14,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:14,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:14,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536. 2023-07-19 19:12:14,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 41fb367440c6c9ee75f9a22bd187e536: 2023-07-19 19:12:14,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:14,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:14,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:12:14,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071. 2023-07-19 19:12:14,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 906386064665ce7cf111ad8f47365071: 2023-07-19 19:12:14,231 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=41fb367440c6c9ee75f9a22bd187e536, regionState=CLOSED 2023-07-19 19:12:14,231 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793934231"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793934231"}]},"ts":"1689793934231"} 2023-07-19 19:12:14,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 906386064665ce7cf111ad8f47365071 2023-07-19 19:12:14,243 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=906386064665ce7cf111ad8f47365071, regionState=CLOSED 2023-07-19 19:12:14,243 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793934243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793934243"}]},"ts":"1689793934243"} 2023-07-19 19:12:14,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-19 19:12:14,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 41fb367440c6c9ee75f9a22bd187e536, server=jenkins-hbase4.apache.org,39767,1689793835630 in 235 msec 2023-07-19 19:12:14,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41fb367440c6c9ee75f9a22bd187e536, UNASSIGN in 245 msec 2023-07-19 19:12:14,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-19 19:12:14,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 906386064665ce7cf111ad8f47365071, server=jenkins-hbase4.apache.org,37775,1689793835515 in 229 msec 2023-07-19 19:12:14,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-19 19:12:14,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=906386064665ce7cf111ad8f47365071, UNASSIGN in 248 msec 2023-07-19 19:12:14,250 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793934250"}]},"ts":"1689793934250"} 2023-07-19 19:12:14,252 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 19:12:14,253 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 19:12:14,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 273 msec 2023-07-19 19:12:14,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 19:12:14,292 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 19:12:14,302 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,316 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,317 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,319 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,323 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,323 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,323 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,324 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:12:14,323 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,324 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071 2023-07-19 19:12:14,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 19:12:14,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 19:12:14,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 19:12:14,330 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,330 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:14,330 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-19 19:12:14,330 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,331 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:14,330 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:14,331 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:12:14,330 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:14,332 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/recovered.edits] 2023-07-19 19:12:14,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 19:12:14,336 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/recovered.edits] 2023-07-19 19:12:14,340 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/cf/a981b4ada9314b0f9b32d3b4a3e0f4ea to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/cf/a981b4ada9314b0f9b32d3b4a3e0f4ea 2023-07-19 19:12:14,341 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/cf/b479b52a4320450693d64ed03388dc5b to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/cf/b479b52a4320450693d64ed03388dc5b 2023-07-19 19:12:14,346 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536/recovered.edits/9.seqid 2023-07-19 19:12:14,351 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41fb367440c6c9ee75f9a22bd187e536 2023-07-19 19:12:14,351 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071/recovered.edits/9.seqid 2023-07-19 19:12:14,352 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/906386064665ce7cf111ad8f47365071 2023-07-19 19:12:14,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 19:12:14,354 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,357 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 19:12:14,359 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 19:12:14,360 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,360 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 19:12:14,361 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793934360"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:14,361 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793934360"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:14,363 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:12:14,363 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 41fb367440c6c9ee75f9a22bd187e536, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689793913833.41fb367440c6c9ee75f9a22bd187e536.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 906386064665ce7cf111ad8f47365071, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793913833.906386064665ce7cf111ad8f47365071.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:12:14,363 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 19:12:14,363 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793934363"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:14,365 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 19:12:14,375 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 73 msec 2023-07-19 19:12:14,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 19:12:14,436 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 19:12:14,449 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 19:12:14,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,455 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 19:12:14,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:14,462 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 19:12:14,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:14,505 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 751) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:57804 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:59442 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1175972246_1 at /127.0.0.1:47810 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4178 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:47824 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:39377 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 910), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=500 (was 370) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 187), AvailableMemoryMB=2651 (was 2766) 2023-07-19 19:12:14,506 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 19:12:14,548 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=500, ProcessCount=188, AvailableMemoryMB=2651 2023-07-19 19:12:14,548 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 19:12:14,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:12:14,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:14,557 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:12:14,558 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 19:12:14,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 19:12:14,563 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:12:14,570 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:14,570 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:14,570 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0 empty. 2023-07-19 19:12:14,570 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f empty. 2023-07-19 19:12:14,571 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:14,571 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:14,571 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 19:12:14,652 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 19:12:14,659 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 62beef422d899099c2b08ceec747f55f, NAME => 'testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:12:14,659 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2f43aecf21a78bdb976ea2ce2d9332d0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:12:14,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 19:12:14,756 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:14,756 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 62beef422d899099c2b08ceec747f55f, disabling compactions & flushes 2023-07-19 19:12:14,756 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:14,756 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:14,756 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. after waiting 0 ms 2023-07-19 19:12:14,756 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:14,757 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:14,757 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 62beef422d899099c2b08ceec747f55f: 2023-07-19 19:12:14,759 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:14,759 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2f43aecf21a78bdb976ea2ce2d9332d0, disabling compactions & flushes 2023-07-19 19:12:14,760 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:14,760 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:14,760 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. after waiting 0 ms 2023-07-19 19:12:14,760 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:14,760 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:14,760 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2f43aecf21a78bdb976ea2ce2d9332d0: 2023-07-19 19:12:14,766 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:12:14,767 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793934767"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793934767"}]},"ts":"1689793934767"} 2023-07-19 19:12:14,767 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793934767"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793934767"}]},"ts":"1689793934767"} 2023-07-19 19:12:14,773 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:12:14,775 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:12:14,775 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793934775"}]},"ts":"1689793934775"} 2023-07-19 19:12:14,777 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 19:12:14,781 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:12:14,783 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:12:14,783 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:12:14,783 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:12:14,783 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:12:14,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=62beef422d899099c2b08ceec747f55f, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2f43aecf21a78bdb976ea2ce2d9332d0, ASSIGN}] 2023-07-19 19:12:14,792 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2f43aecf21a78bdb976ea2ce2d9332d0, ASSIGN 2023-07-19 19:12:14,793 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=62beef422d899099c2b08ceec747f55f, ASSIGN 2023-07-19 19:12:14,793 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2f43aecf21a78bdb976ea2ce2d9332d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37775,1689793835515; forceNewPlan=false, retain=false 2023-07-19 19:12:14,794 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=62beef422d899099c2b08ceec747f55f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39881,1689793835575; forceNewPlan=false, retain=false 2023-07-19 19:12:14,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 19:12:14,944 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:12:14,948 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=62beef422d899099c2b08ceec747f55f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:14,948 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=2f43aecf21a78bdb976ea2ce2d9332d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:14,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793934948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793934948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793934948"}]},"ts":"1689793934948"} 2023-07-19 19:12:14,948 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793934948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793934948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793934948"}]},"ts":"1689793934948"} 2023-07-19 19:12:14,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 62beef422d899099c2b08ceec747f55f, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:12:14,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 2f43aecf21a78bdb976ea2ce2d9332d0, server=jenkins-hbase4.apache.org,37775,1689793835515}] 2023-07-19 19:12:15,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:15,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62beef422d899099c2b08ceec747f55f, NAME => 'testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:12:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. service=AccessControlService 2023-07-19 19:12:15,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:12:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:15,114 INFO [StoreOpener-62beef422d899099c2b08ceec747f55f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:15,116 DEBUG [StoreOpener-62beef422d899099c2b08ceec747f55f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/cf 2023-07-19 19:12:15,116 DEBUG [StoreOpener-62beef422d899099c2b08ceec747f55f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/cf 2023-07-19 19:12:15,117 INFO [StoreOpener-62beef422d899099c2b08ceec747f55f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62beef422d899099c2b08ceec747f55f columnFamilyName cf 2023-07-19 19:12:15,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:15,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f43aecf21a78bdb976ea2ce2d9332d0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:12:15,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. service=AccessControlService 2023-07-19 19:12:15,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:12:15,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:15,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:15,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:15,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:15,118 INFO [StoreOpener-62beef422d899099c2b08ceec747f55f-1] regionserver.HStore(310): Store=62beef422d899099c2b08ceec747f55f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:12:15,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:15,119 INFO [StoreOpener-2f43aecf21a78bdb976ea2ce2d9332d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:15,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:15,122 DEBUG [StoreOpener-2f43aecf21a78bdb976ea2ce2d9332d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/cf 2023-07-19 19:12:15,122 DEBUG [StoreOpener-2f43aecf21a78bdb976ea2ce2d9332d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/cf 2023-07-19 19:12:15,122 INFO [StoreOpener-2f43aecf21a78bdb976ea2ce2d9332d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f43aecf21a78bdb976ea2ce2d9332d0 columnFamilyName cf 2023-07-19 19:12:15,123 INFO [StoreOpener-2f43aecf21a78bdb976ea2ce2d9332d0-1] regionserver.HStore(310): Store=2f43aecf21a78bdb976ea2ce2d9332d0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:12:15,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:15,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:15,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:15,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:12:15,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 62beef422d899099c2b08ceec747f55f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62211189, jitterRate=-0.07298104465007782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:12:15,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 62beef422d899099c2b08ceec747f55f: 2023-07-19 19:12:15,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:12:15,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f., pid=93, masterSystemTime=1689793935108 2023-07-19 19:12:15,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f43aecf21a78bdb976ea2ce2d9332d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70994331, jitterRate=0.05789797008037567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:12:15,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f43aecf21a78bdb976ea2ce2d9332d0: 2023-07-19 19:12:15,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0., pid=94, masterSystemTime=1689793935113 2023-07-19 19:12:15,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:15,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:15,132 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=62beef422d899099c2b08ceec747f55f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:15,132 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793935132"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793935132"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793935132"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793935132"}]},"ts":"1689793935132"} 2023-07-19 19:12:15,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:15,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:15,133 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=2f43aecf21a78bdb976ea2ce2d9332d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:15,134 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793935133"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793935133"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793935133"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793935133"}]},"ts":"1689793935133"} 2023-07-19 19:12:15,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 19:12:15,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 62beef422d899099c2b08ceec747f55f, server=jenkins-hbase4.apache.org,39881,1689793835575 in 184 msec 2023-07-19 19:12:15,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 19:12:15,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=62beef422d899099c2b08ceec747f55f, ASSIGN in 354 msec 2023-07-19 19:12:15,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 2f43aecf21a78bdb976ea2ce2d9332d0, server=jenkins-hbase4.apache.org,37775,1689793835515 in 178 msec 2023-07-19 19:12:15,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-19 19:12:15,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2f43aecf21a78bdb976ea2ce2d9332d0, ASSIGN in 356 msec 2023-07-19 19:12:15,144 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:12:15,144 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793935144"}]},"ts":"1689793935144"} 2023-07-19 19:12:15,146 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 19:12:15,150 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:12:15,150 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 19:12:15,152 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:12:15,153 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:15,153 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:15,153 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:15,153 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:15,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:15,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:15,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:15,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:15,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 606 msec 2023-07-19 19:12:15,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 19:12:15,166 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 19:12:15,166 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 19:12:15,166 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:15,174 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 19:12:15,174 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:15,174 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-19 19:12:15,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:15,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793935196 (current time:1689793935196). 2023-07-19 19:12:15,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:12:15,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x6de14e5c to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:15,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c5b4d4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:15,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:15,250 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:15,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6de14e5c to 127.0.0.1:50021 2023-07-19 19:12:15,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:15,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x12b80990 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:15,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@754c2635, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:15,294 DEBUG [hconnection-0x636b1cc2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:15,298 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:15,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:15,308 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:15,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12b80990 to 127.0.0.1:50021 2023-07-19 19:12:15,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:15,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:12:15,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:12:15,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:15,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:15,318 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:15,323 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689794535323 2023-07-19 19:12:15,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:15,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:15,326 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:12:15,326 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:12:15,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:15,329 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:15,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 18 msec 2023-07-19 19:12:15,340 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:15,341 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689794535341 2023-07-19 19:12:15,426 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:15,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:15,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:15,428 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:12:15,628 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:15,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:15,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:15,630 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:12:15,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,783 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 19:12:15,783 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:15,783 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 19:12:15,783 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 19:12:15,785 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,785 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,881 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:15,881 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:15,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:15,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:15,881 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:15,881 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:15,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,882 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,882 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,883 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:15,883 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:12:15,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 19:12:15,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 19:12:15,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,884 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:15,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 19:12:15,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,884 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:15,884 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:15,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:15,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,897 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:15,897 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,897 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:15,897 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:15,897 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:15,897 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:15,898 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:15,899 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:15,899 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:15,902 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:15,902 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:15,902 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:15,925 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,925 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:15,931 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:15,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:15,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:15,932 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 19:12:15,940 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:15,940 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:15,940 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:15,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:15,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:15,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:15,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 19:12:15,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58ebc173[Count = 1] remaining members to acquire global barrier 2023-07-19 19:12:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:15,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:15,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:15,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:15,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:15,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 19:12:15,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58ebc173[Count = 0] remaining members to acquire global barrier 2023-07-19 19:12:15,946 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 19:12:15,946 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,979 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,979 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,979 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:15,979 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:15,979 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:12:15,979 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,980 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:15,980 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:15,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,980 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:15,980 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:15,981 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:15,981 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:15,981 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:15,981 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:15,981 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. started... 2023-07-19 19:12:15,982 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:15,982 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f43aecf21a78bdb976ea2ce2d9332d0: 2023-07-19 19:12:15,982 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:12:15,982 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:15,983 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. started... 2023-07-19 19:12:15,983 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,983 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:15,983 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:12:15,984 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 62beef422d899099c2b08ceec747f55f: 2023-07-19 19:12:15,984 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:15,984 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:15,985 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:12:16,025 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:16,025 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:16,025 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:16,079 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. completed. 2023-07-19 19:12:16,079 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:16,079 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:16,079 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:16,079 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,079 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:16,079 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:12:16,082 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. completed. 2023-07-19 19:12:16,083 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:16,083 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:16,083 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:16,083 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,083 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:16,083 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:12:16,125 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:16,125 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,125 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:16,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:16,125 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:16,132 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:16,133 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:16,133 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:16,133 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:16,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39881,1689793835575': 2023-07-19 19:12:16,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 19:12:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37775,1689793835515': 2023-07-19 19:12:16,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 19:12:16,142 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 19:12:16,142 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:12:16,142 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:12:16,142 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,142 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:12:16,144 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,144 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,144 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,145 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,145 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,144 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,153 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:16,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:16,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:16,154 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,154 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:16,154 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:16,156 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,157 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,157 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,160 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,160 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:16,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:16,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:16,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,161 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:16,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,161 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,164 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:16,164 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 19:12:16,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,220 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689793935324Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689793936161 (+837 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689793936161Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689793936167 (+6 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689793936180 (+13 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689793936219 (+39 ms) 2023-07-19 19:12:16,224 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:16,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 899 msec 2023-07-19 19:12:16,433 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:16,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:16,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:12:16,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39881] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:12:16,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37775] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:12:16,444 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:16,444 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:16,444 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:16,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:16,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793936454 (current time:1689793936454). 2023-07-19 19:12:16,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:12:16,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x33c9a12a to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:16,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8ff369d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:16,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:16,467 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:16,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33c9a12a to 127.0.0.1:50021 2023-07-19 19:12:16,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:16,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x69a53e92 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:16,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@179b027d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:16,479 DEBUG [hconnection-0x662185cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:16,480 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:16,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:16,485 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:16,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69a53e92 to 127.0.0.1:50021 2023-07-19 19:12:16,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:16,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:12:16,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:12:16,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:16,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:16,491 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:16,491 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689794536491 2023-07-19 19:12:16,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:16,491 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:16,493 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:12:16,493 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:12:16,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:16,498 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:16,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-19 19:12:16,500 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:16,500 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689794536500 2023-07-19 19:12:16,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,515 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 19:12:16,516 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:16,517 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 19:12:16,517 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 19:12:16,518 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,518 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,520 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:16,520 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:16,520 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:16,520 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:16,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:16,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:16,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:16,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:16,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:16,521 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,521 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,521 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,521 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:12:16,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:16,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,523 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:16,523 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:16,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,523 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:16,523 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:16,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:16,528 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:16,532 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:16,532 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:16,532 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:16,534 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,534 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,534 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:16,534 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,534 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:16,534 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:16,534 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:16,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,536 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,536 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,536 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,536 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:16,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 19:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4464f5b[Count = 1] remaining members to acquire global barrier 2023-07-19 19:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:16,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:16,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 19:12:16,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4464f5b[Count = 0] remaining members to acquire global barrier 2023-07-19 19:12:16,539 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 19:12:16,539 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,543 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,543 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,543 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,543 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:16,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,543 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:16,543 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,544 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:16,543 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:16,544 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. started... 2023-07-19 19:12:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,544 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:16,544 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:16,544 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:16,544 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 62beef422d899099c2b08ceec747f55f 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-19 19:12:16,544 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. started... 2023-07-19 19:12:16,544 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:16,544 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,544 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:12:16,544 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:16,544 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2f43aecf21a78bdb976ea2ce2d9332d0 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-19 19:12:16,544 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:16,544 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:12:16,546 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:16,546 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:16,546 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:16,566 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/.tmp/cf/da03bfd17f12444a9b78065981ed9581 2023-07-19 19:12:16,569 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/.tmp/cf/6755d71a94434b5997847cc20eb616b3 2023-07-19 19:12:16,574 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/.tmp/cf/da03bfd17f12444a9b78065981ed9581 as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/cf/da03bfd17f12444a9b78065981ed9581 2023-07-19 19:12:16,580 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/cf/da03bfd17f12444a9b78065981ed9581, entries=6, sequenceid=6, filesize=5.2 K 2023-07-19 19:12:16,580 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/.tmp/cf/6755d71a94434b5997847cc20eb616b3 as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/cf/6755d71a94434b5997847cc20eb616b3 2023-07-19 19:12:16,581 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 62beef422d899099c2b08ceec747f55f in 37ms, sequenceid=6, compaction requested=false 2023-07-19 19:12:16,581 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 19:12:16,582 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 62beef422d899099c2b08ceec747f55f: 2023-07-19 19:12:16,582 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,582 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:16,582 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/cf/da03bfd17f12444a9b78065981ed9581] hfiles 2023-07-19 19:12:16,582 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/cf/da03bfd17f12444a9b78065981ed9581 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,586 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/cf/6755d71a94434b5997847cc20eb616b3, entries=44, sequenceid=6, filesize=7.8 K 2023-07-19 19:12:16,587 INFO [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 2f43aecf21a78bdb976ea2ce2d9332d0 in 43ms, sequenceid=6, compaction requested=false 2023-07-19 19:12:16,592 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f43aecf21a78bdb976ea2ce2d9332d0: 2023-07-19 19:12:16,592 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,594 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:16,594 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:16,594 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/cf/6755d71a94434b5997847cc20eb616b3] hfiles 2023-07-19 19:12:16,594 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/cf/6755d71a94434b5997847cc20eb616b3 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:16,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:16,595 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:12:16,608 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. completed. 2023-07-19 19:12:16,608 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:16,608 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:16,608 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:16,608 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,610 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:16,610 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:12:16,612 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,612 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:16,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:16,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:16,612 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:16,613 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:16,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:16,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:16,616 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. completed. 2023-07-19 19:12:16,616 DEBUG [rs(jenkins-hbase4.apache.org,37775,1689793835515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:16,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,616 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:16,616 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:16,616 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,616 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:16,616 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:12:16,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,618 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,618 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:16,618 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:16,618 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:16,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:16,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39881,1689793835575': 2023-07-19 19:12:16,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 19:12:16,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:16,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:16,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:16,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:16,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:16,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37775,1689793835515': 2023-07-19 19:12:16,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 19:12:16,625 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 19:12:16,625 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:12:16,625 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:12:16,625 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,625 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:12:16,628 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:16,628 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:16,628 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,629 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:16,630 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:16,631 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,632 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,632 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,635 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,635 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,635 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,635 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:16,635 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,635 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:16,635 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:16,635 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:16,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:16,636 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:16,635 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,636 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:16,636 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:16,636 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:16,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:16,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,638 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,638 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:16,638 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:16,638 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,638 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:16,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:16,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 19:12:16,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,699 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689793936491Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689793936637 (+146 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689793936638 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689793936642 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689793936652 (+10 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689793936698 (+46 ms) 2023-07-19 19:12:16,702 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:16,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 209 msec 2023-07-19 19:12:16,795 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:16,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:16,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:12:16,797 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797 2023-07-19 19:12:16,797 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39651, tgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797, rawTgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797, srcFsUri=hdfs://localhost:39651, srcDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:12:16,822 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:12:16,822 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1690278752_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,822 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7, snapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 19:12:16,832 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:16,876 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,876 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,877 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,877 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,877 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,878 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,878 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,952 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop-5914355641784691623.jar 2023-07-19 19:12:16,953 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,953 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,953 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,954 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,954 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,954 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:16,955 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:12:16,955 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:12:16,956 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:12:16,956 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:12:16,956 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:12:16,957 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:12:16,957 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:12:16,957 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:12:16,957 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:12:16,958 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:12:16,958 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:16,959 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:16,959 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:16,959 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:16,960 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:16,960 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:16,960 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:17,567 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:17,962 WARN [Listener at jenkins-hbase4.apache.org/41077] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:12:17,965 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 19:12:18,129 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:18,129 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:18,553 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0006_000001 (auth:SIMPLE) 2023-07-19 19:12:19,137 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:12:24,236 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0006_000001 (auth:SIMPLE) 2023-07-19 19:12:27,481 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:12:27,482 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:12:27,536 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:27,536 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:12:27,539 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:12:27,539 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:27,541 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 19:12:27,541 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 19:12:27,541 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:27,541 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 19:12:27,542 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793936797/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 19:12:27,569 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 19:12:27,577 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793947576"}]},"ts":"1689793947576"} 2023-07-19 19:12:27,580 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 19:12:27,583 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 19:12:27,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=62beef422d899099c2b08ceec747f55f, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2f43aecf21a78bdb976ea2ce2d9332d0, UNASSIGN}] 2023-07-19 19:12:27,585 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=62beef422d899099c2b08ceec747f55f, UNASSIGN 2023-07-19 19:12:27,588 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2f43aecf21a78bdb976ea2ce2d9332d0, UNASSIGN 2023-07-19 19:12:27,589 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=62beef422d899099c2b08ceec747f55f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:27,589 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793947589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793947589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793947589"}]},"ts":"1689793947589"} 2023-07-19 19:12:27,589 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=2f43aecf21a78bdb976ea2ce2d9332d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:27,589 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793947589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793947589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793947589"}]},"ts":"1689793947589"} 2023-07-19 19:12:27,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 62beef422d899099c2b08ceec747f55f, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:12:27,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 2f43aecf21a78bdb976ea2ce2d9332d0, server=jenkins-hbase4.apache.org,37775,1689793835515}] 2023-07-19 19:12:27,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 19:12:27,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:27,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 62beef422d899099c2b08ceec747f55f, disabling compactions & flushes 2023-07-19 19:12:27,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:27,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:27,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. after waiting 0 ms 2023-07-19 19:12:27,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:27,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:27,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f43aecf21a78bdb976ea2ce2d9332d0, disabling compactions & flushes 2023-07-19 19:12:27,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:27,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:27,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. after waiting 0 ms 2023-07-19 19:12:27,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:27,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:27,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:27,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f. 2023-07-19 19:12:27,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 62beef422d899099c2b08ceec747f55f: 2023-07-19 19:12:27,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:27,818 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=62beef422d899099c2b08ceec747f55f, regionState=CLOSED 2023-07-19 19:12:27,819 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793947818"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793947818"}]},"ts":"1689793947818"} 2023-07-19 19:12:27,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:27,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:27,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0. 2023-07-19 19:12:27,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f43aecf21a78bdb976ea2ce2d9332d0: 2023-07-19 19:12:27,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:27,825 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=2f43aecf21a78bdb976ea2ce2d9332d0, regionState=CLOSED 2023-07-19 19:12:27,825 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793947825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793947825"}]},"ts":"1689793947825"} 2023-07-19 19:12:27,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 19:12:27,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 62beef422d899099c2b08ceec747f55f, server=jenkins-hbase4.apache.org,39881,1689793835575 in 230 msec 2023-07-19 19:12:27,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=62beef422d899099c2b08ceec747f55f, UNASSIGN in 242 msec 2023-07-19 19:12:27,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 19:12:27,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 2f43aecf21a78bdb976ea2ce2d9332d0, server=jenkins-hbase4.apache.org,37775,1689793835515 in 236 msec 2023-07-19 19:12:27,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-19 19:12:27,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2f43aecf21a78bdb976ea2ce2d9332d0, UNASSIGN in 246 msec 2023-07-19 19:12:27,832 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793947832"}]},"ts":"1689793947832"} 2023-07-19 19:12:27,834 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 19:12:27,835 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 19:12:27,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 266 msec 2023-07-19 19:12:27,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 19:12:27,879 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 19:12:27,879 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,883 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,884 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,886 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,889 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:27,889 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:27,889 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,889 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,889 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,889 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,890 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 19:12:27,890 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 19:12:27,890 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 19:12:27,890 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 19:12:27,891 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,891 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,891 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,891 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:27,891 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:27,891 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:27,891 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,892 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:27,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 19:12:27,892 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/recovered.edits] 2023-07-19 19:12:27,893 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/recovered.edits] 2023-07-19 19:12:27,898 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/cf/da03bfd17f12444a9b78065981ed9581 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/cf/da03bfd17f12444a9b78065981ed9581 2023-07-19 19:12:27,899 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/cf/6755d71a94434b5997847cc20eb616b3 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/cf/6755d71a94434b5997847cc20eb616b3 2023-07-19 19:12:27,904 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f/recovered.edits/9.seqid 2023-07-19 19:12:27,904 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0/recovered.edits/9.seqid 2023-07-19 19:12:27,904 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/62beef422d899099c2b08ceec747f55f 2023-07-19 19:12:27,905 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testEmptyExportFileSystemState/2f43aecf21a78bdb976ea2ce2d9332d0 2023-07-19 19:12:27,905 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 19:12:27,907 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,912 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 19:12:27,923 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 19:12:27,924 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,924 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 19:12:27,924 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793947924"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:27,924 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793947924"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:27,928 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:12:27,928 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 62beef422d899099c2b08ceec747f55f, NAME => 'testtb-testEmptyExportFileSystemState,,1689793934550.62beef422d899099c2b08ceec747f55f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2f43aecf21a78bdb976ea2ce2d9332d0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689793934550.2f43aecf21a78bdb976ea2ce2d9332d0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:12:27,929 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 19:12:27,929 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793947929"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:27,930 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 19:12:27,932 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:27,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 54 msec 2023-07-19 19:12:27,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 19:12:27,994 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 19:12:28,006 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 19:12:28,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:28,010 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 19:12:28,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:28,044 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 762) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:41611 from appattempt_1689793843503_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-889862492_1 at /127.0.0.1:56722 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4830 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:54744 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:46992 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-889862492_1 at /127.0.0.1:54726 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:46261 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:56736 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=575 (was 500) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 188), AvailableMemoryMB=1808 (was 2651) 2023-07-19 19:12:28,044 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-19 19:12:28,073 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=575, ProcessCount=184, AvailableMemoryMB=1800 2023-07-19 19:12:28,073 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-19 19:12:28,076 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:12:28,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:28,082 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:12:28,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 19:12:28,083 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:12:28,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 19:12:28,086 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:28,086 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:28,086 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1 empty. 2023-07-19 19:12:28,086 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475 empty. 2023-07-19 19:12:28,087 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:28,087 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:28,087 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 19:12:28,172 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 19:12:28,175 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => f959c10424becc459172b0a7d15be4a1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:12:28,176 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0edbc0b4e76478c3c2f7217f76c10475, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp 2023-07-19 19:12:28,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 19:12:28,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:28,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing f959c10424becc459172b0a7d15be4a1, disabling compactions & flushes 2023-07-19 19:12:28,278 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:28,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:28,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. after waiting 0 ms 2023-07-19 19:12:28,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:28,278 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:28,278 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for f959c10424becc459172b0a7d15be4a1: 2023-07-19 19:12:28,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 19:12:28,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:28,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 0edbc0b4e76478c3c2f7217f76c10475, disabling compactions & flushes 2023-07-19 19:12:28,676 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:28,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:28,677 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. after waiting 0 ms 2023-07-19 19:12:28,677 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:28,677 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:28,677 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 0edbc0b4e76478c3c2f7217f76c10475: 2023-07-19 19:12:28,688 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:12:28,689 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793948689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793948689"}]},"ts":"1689793948689"} 2023-07-19 19:12:28,689 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793948689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793948689"}]},"ts":"1689793948689"} 2023-07-19 19:12:28,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 19:12:28,694 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:12:28,695 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:12:28,696 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793948695"}]},"ts":"1689793948695"} 2023-07-19 19:12:28,700 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 19:12:28,704 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:12:28,706 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:12:28,706 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:12:28,706 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:12:28,706 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:12:28,706 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f959c10424becc459172b0a7d15be4a1, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0edbc0b4e76478c3c2f7217f76c10475, ASSIGN}] 2023-07-19 19:12:28,713 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0edbc0b4e76478c3c2f7217f76c10475, ASSIGN 2023-07-19 19:12:28,713 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f959c10424becc459172b0a7d15be4a1, ASSIGN 2023-07-19 19:12:28,714 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0edbc0b4e76478c3c2f7217f76c10475, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39881,1689793835575; forceNewPlan=false, retain=false 2023-07-19 19:12:28,714 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f959c10424becc459172b0a7d15be4a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39767,1689793835630; forceNewPlan=false, retain=false 2023-07-19 19:12:28,864 INFO [jenkins-hbase4:43163] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:12:28,868 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0edbc0b4e76478c3c2f7217f76c10475, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:28,869 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793948868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793948868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793948868"}]},"ts":"1689793948868"} 2023-07-19 19:12:28,869 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f959c10424becc459172b0a7d15be4a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:28,869 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793948869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793948869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793948869"}]},"ts":"1689793948869"} 2023-07-19 19:12:28,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 0edbc0b4e76478c3c2f7217f76c10475, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:12:28,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure f959c10424becc459172b0a7d15be4a1, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:12:29,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:29,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0edbc0b4e76478c3c2f7217f76c10475, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:12:29,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. service=AccessControlService 2023-07-19 19:12:29,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:12:29,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:29,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:29,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:29,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:29,040 INFO [StoreOpener-0edbc0b4e76478c3c2f7217f76c10475-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:29,044 DEBUG [StoreOpener-0edbc0b4e76478c3c2f7217f76c10475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/cf 2023-07-19 19:12:29,044 DEBUG [StoreOpener-0edbc0b4e76478c3c2f7217f76c10475-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/cf 2023-07-19 19:12:29,045 INFO [StoreOpener-0edbc0b4e76478c3c2f7217f76c10475-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0edbc0b4e76478c3c2f7217f76c10475 columnFamilyName cf 2023-07-19 19:12:29,049 INFO [StoreOpener-0edbc0b4e76478c3c2f7217f76c10475-1] regionserver.HStore(310): Store=0edbc0b4e76478c3c2f7217f76c10475/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:12:29,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:29,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f959c10424becc459172b0a7d15be4a1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:12:29,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. service=AccessControlService 2023-07-19 19:12:29,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:12:29,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:29,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:29,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:29,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:29,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:29,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:29,054 INFO [StoreOpener-f959c10424becc459172b0a7d15be4a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:29,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:29,089 DEBUG [StoreOpener-f959c10424becc459172b0a7d15be4a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/cf 2023-07-19 19:12:29,090 DEBUG [StoreOpener-f959c10424becc459172b0a7d15be4a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/cf 2023-07-19 19:12:29,090 INFO [StoreOpener-f959c10424becc459172b0a7d15be4a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f959c10424becc459172b0a7d15be4a1 columnFamilyName cf 2023-07-19 19:12:29,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:12:29,091 INFO [StoreOpener-f959c10424becc459172b0a7d15be4a1-1] regionserver.HStore(310): Store=f959c10424becc459172b0a7d15be4a1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:12:29,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:29,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:29,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0edbc0b4e76478c3c2f7217f76c10475; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62336655, jitterRate=-0.07111145555973053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:12:29,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0edbc0b4e76478c3c2f7217f76c10475: 2023-07-19 19:12:29,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475., pid=108, masterSystemTime=1689793949033 2023-07-19 19:12:29,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:29,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:29,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:29,099 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0edbc0b4e76478c3c2f7217f76c10475, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,100 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793949099"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793949099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793949099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793949099"}]},"ts":"1689793949099"} 2023-07-19 19:12:29,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-19 19:12:29,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 0edbc0b4e76478c3c2f7217f76c10475, server=jenkins-hbase4.apache.org,39881,1689793835575 in 227 msec 2023-07-19 19:12:29,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0edbc0b4e76478c3c2f7217f76c10475, ASSIGN in 399 msec 2023-07-19 19:12:29,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:12:29,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f959c10424becc459172b0a7d15be4a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63094267, jitterRate=-0.05982215702533722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:12:29,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f959c10424becc459172b0a7d15be4a1: 2023-07-19 19:12:29,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1., pid=109, masterSystemTime=1689793949034 2023-07-19 19:12:29,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:29,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:29,115 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f959c10424becc459172b0a7d15be4a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,115 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793949115"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793949115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793949115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793949115"}]},"ts":"1689793949115"} 2023-07-19 19:12:29,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-19 19:12:29,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure f959c10424becc459172b0a7d15be4a1, server=jenkins-hbase4.apache.org,39767,1689793835630 in 235 msec 2023-07-19 19:12:29,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-19 19:12:29,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f959c10424becc459172b0a7d15be4a1, ASSIGN in 414 msec 2023-07-19 19:12:29,129 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:12:29,129 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793949129"}]},"ts":"1689793949129"} 2023-07-19 19:12:29,131 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 19:12:29,134 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:12:29,134 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 19:12:29,137 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 19:12:29,139 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:29,139 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:29,139 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:29,139 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:29,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:29,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:29,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:29,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:29,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 1.0660 sec 2023-07-19 19:12:29,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 19:12:29,192 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 19:12:29,192 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-19 19:12:29,193 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:29,197 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-19 19:12:29,197 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:29,197 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-19 19:12:29,201 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:29,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793949201 (current time:1689793949201). 2023-07-19 19:12:29,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:12:29,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x1b01835c to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:29,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23eae111, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:29,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:29,268 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:29,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b01835c to 127.0.0.1:50021 2023-07-19 19:12:29,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:29,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x5128f88b to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:29,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46249a91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:29,311 DEBUG [hconnection-0x3232092d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:29,315 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:29,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:29,323 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:29,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5128f88b to 127.0.0.1:50021 2023-07-19 19:12:29,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:29,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 19:12:29,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:12:29,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:29,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:29,329 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:29,335 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689794549334 2023-07-19 19:12:29,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:29,337 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:12:29,337 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:12:29,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:29,341 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:29,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 14 msec 2023-07-19 19:12:29,344 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:29,344 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689794549344 2023-07-19 19:12:29,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,388 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 19:12:29,389 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:29,390 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 19:12:29,390 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 19:12:29,391 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,391 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,392 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:29,392 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:29,392 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:29,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:29,392 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:29,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:29,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:29,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:29,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:29,393 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,393 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,394 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,394 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:12:29,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 19:12:29,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 19:12:29,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:29,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 19:12:29,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:29,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:29,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,398 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:29,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,398 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:29,399 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:29,399 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:29,401 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:29,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,402 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:29,402 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:29,406 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:29,406 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:29,406 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:29,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:29,409 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:29,410 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:29,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 19:12:29,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ddd68ca[Count = 1] remaining members to acquire global barrier 2023-07-19 19:12:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:29,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:29,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:29,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:29,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 19:12:29,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ddd68ca[Count = 0] remaining members to acquire global barrier 2023-07-19 19:12:29,420 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 19:12:29,420 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:29,422 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:29,422 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:12:29,422 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:29,422 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. started... 2023-07-19 19:12:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:29,422 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,424 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f959c10424becc459172b0a7d15be4a1: 2023-07-19 19:12:29,422 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:29,425 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:29,422 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. started... 2023-07-19 19:12:29,424 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:12:29,424 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:29,425 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,426 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:29,426 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0edbc0b4e76478c3c2f7217f76c10475: 2023-07-19 19:12:29,426 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:12:29,426 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:29,426 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:29,426 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:29,426 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,428 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:29,428 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:12:29,437 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:29,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:29,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:29,439 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:12:29,445 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. completed. 2023-07-19 19:12:29,445 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:12:29,448 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:29,448 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:29,448 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:29,450 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:29,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:29,450 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. completed. 2023-07-19 19:12:29,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:29,450 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:29,451 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:29,451 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:29,451 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,451 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:29,451 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:12:29,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:29,453 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:29,453 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:29,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39881,1689793835575': 2023-07-19 19:12:29,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 19:12:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:29,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39767,1689793835630': 2023-07-19 19:12:29,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 19:12:29,481 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 19:12:29,481 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:12:29,482 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:12:29,482 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,482 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:12:29,485 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,485 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,485 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:29,485 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:29,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:29,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:29,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,487 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,487 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:29,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,487 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:29,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:29,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,488 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:29,489 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,489 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,494 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,495 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,496 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,501 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:29,501 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:29,501 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:29,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,501 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:29,501 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:29,501 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:29,501 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:29,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:29,501 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,504 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,504 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,504 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,504 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,504 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:29,505 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:29,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:29,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:29,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:29,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:29,505 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,506 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,506 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,506 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,506 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:29,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,597 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 19:12:29,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,598 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689793949335Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689793949501 (+166 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689793949501Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689793949515 (+14 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689793949543 (+28 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689793949597 (+54 ms) 2023-07-19 19:12:29,602 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:29,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 266 msec 2023-07-19 19:12:29,639 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:29,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:29,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:12:29,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39767] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:12:29,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39881] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:12:29,653 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,653 DEBUG [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:29,653 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:29,667 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:29,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793949667 (current time:1689793949667). 2023-07-19 19:12:29,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:12:29,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x5042ef5b to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:29,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@729bef1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:29,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:29,683 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:29,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5042ef5b to 127.0.0.1:50021 2023-07-19 19:12:29,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:29,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(139): Connect 0x36606651 to 127.0.0.1:50021 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:29,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@719f6ff1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:29,706 DEBUG [hconnection-0x5cd185ca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:29,710 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:29,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:29,719 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:29,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36606651 to 127.0.0.1:50021 2023-07-19 19:12:29,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:29,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 19:12:29,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:12:29,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:29,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:29,726 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:29,727 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689794549727 2023-07-19 19:12:29,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:29,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,729 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:12:29,729 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:12:29,731 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:29,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:29,739 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-19 19:12:29,741 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:29,742 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689794549742 2023-07-19 19:12:29,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,819 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 19:12:29,819 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:29,828 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 19:12:29,828 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 19:12:29,829 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:29,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:29,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:29,831 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:12:29,835 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,835 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,837 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:29,837 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:29,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:29,837 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:29,837 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:29,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:29,838 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,838 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,838 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,838 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:12:29,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:29,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:29,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,848 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:29,848 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:29,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37775,1689793835515' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:29,853 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:29,852 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:29,853 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:29,854 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:29,854 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:29,854 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:29,856 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,856 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:29,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:29,856 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,857 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,857 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,857 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:29,857 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,859 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,859 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:29,859 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,859 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:29,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:29,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:29,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:29,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39881,1689793835575' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 19:12:29,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@945bdfe[Count = 1] remaining members to acquire global barrier 2023-07-19 19:12:29,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:29,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:29,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:29,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:29,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:29,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:29,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39767,1689793835630' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 19:12:29,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@945bdfe[Count = 0] remaining members to acquire global barrier 2023-07-19 19:12:29,864 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 19:12:29,865 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,871 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,871 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:29,871 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37775,1689793835515' in zk 2023-07-19 19:12:29,872 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:29,872 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:12:29,873 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:29,873 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:29,873 DEBUG [member: 'jenkins-hbase4.apache.org,37775,1689793835515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:29,878 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:29,894 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:29,895 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:29,895 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:29,895 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. started... 2023-07-19 19:12:29,895 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f959c10424becc459172b0a7d15be4a1 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 19:12:29,896 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:29,896 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:29,896 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:29,896 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. started... 2023-07-19 19:12:29,899 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0edbc0b4e76478c3c2f7217f76c10475 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 19:12:29,932 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/.tmp/cf/d8acbe303ca14059b1b7ac1a6443d838 2023-07-19 19:12:29,934 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/.tmp/cf/fdb48d67f85b482cb9506a8889a2bcce 2023-07-19 19:12:29,941 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/.tmp/cf/d8acbe303ca14059b1b7ac1a6443d838 as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/cf/d8acbe303ca14059b1b7ac1a6443d838 2023-07-19 19:12:29,943 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/.tmp/cf/fdb48d67f85b482cb9506a8889a2bcce as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/cf/fdb48d67f85b482cb9506a8889a2bcce 2023-07-19 19:12:29,948 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/cf/d8acbe303ca14059b1b7ac1a6443d838, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 19:12:29,950 INFO [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0edbc0b4e76478c3c2f7217f76c10475 in 51ms, sequenceid=6, compaction requested=false 2023-07-19 19:12:29,950 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 19:12:29,950 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0edbc0b4e76478c3c2f7217f76c10475: 2023-07-19 19:12:29,951 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,951 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:29,951 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/cf/d8acbe303ca14059b1b7ac1a6443d838] hfiles 2023-07-19 19:12:29,951 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/cf/d8acbe303ca14059b1b7ac1a6443d838 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,951 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/cf/fdb48d67f85b482cb9506a8889a2bcce, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 19:12:29,952 INFO [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f959c10424becc459172b0a7d15be4a1 in 57ms, sequenceid=6, compaction requested=false 2023-07-19 19:12:29,954 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f959c10424becc459172b0a7d15be4a1: 2023-07-19 19:12:29,954 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:29,954 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:29,955 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/cf/fdb48d67f85b482cb9506a8889a2bcce] hfiles 2023-07-19 19:12:29,955 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/cf/fdb48d67f85b482cb9506a8889a2bcce for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,025 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. completed. 2023-07-19 19:12:30,026 DEBUG [rs(jenkins-hbase4.apache.org,39881,1689793835575)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:30,025 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. completed. 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:30,026 DEBUG [rs(jenkins-hbase4.apache.org,39767,1689793835630)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39767,1689793835630' in zk 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:30,026 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39881,1689793835575' in zk 2023-07-19 19:12:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:30,028 DEBUG [member: 'jenkins-hbase4.apache.org,39881,1689793835575' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:30,029 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:30,029 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:30,029 DEBUG [member: 'jenkins-hbase4.apache.org,39767,1689793835630' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:30,031 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:30,031 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,033 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:30,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:30,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:30,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:30,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:30,034 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:12:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:30,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39881,1689793835575': 2023-07-19 19:12:30,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39881,1689793835575' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 19:12:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:30,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:30,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:30,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39767,1689793835630': 2023-07-19 19:12:30,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39767,1689793835630' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 19:12:30,045 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 19:12:30,045 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:12:30,045 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:12:30,045 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,045 INFO [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:12:30,046 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:30,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:30,046 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:30,047 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,047 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:30,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:30,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:30,048 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,049 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:30,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:30,052 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,053 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,054 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,058 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:30,058 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:30,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:30,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:30,058 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:30,058 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:30,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:30,058 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:30,058 DEBUG [(jenkins-hbase4.apache.org,43163,1689793834027)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:30,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:30,058 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:30,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:30,058 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:30,061 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:30,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:30,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,061 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:30,061 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,061 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:30,062 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:30,062 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,062 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:12:30,062 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:30,062 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,062 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:30,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:30,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,335 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:30,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:30,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:30,337 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 19:12:30,546 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 19:12:30,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,547 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689793949727Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689793950061 (+334 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689793950062 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689793950065 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689793950075 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689793950546 (+471 ms) 2023-07-19 19:12:30,550 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:30,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 821 msec 2023-07-19 19:12:30,837 DEBUG [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:30,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:30,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:12:30,838 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838 2023-07-19 19:12:30,839 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39651, tgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838, rawTgtDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838, srcFsUri=hdfs://localhost:39651, srcDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:12:30,861 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7 2023-07-19 19:12:30,862 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1126377449_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,862 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39651, inputRoot=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7, snapshotDir=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 19:12:30,874 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:30,926 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:30,927 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:30,928 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:30,928 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:30,929 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:30,929 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:30,930 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:31,022 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/hadoop-2256198966524972587.jar 2023-07-19 19:12:31,022 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:31,022 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:31,023 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:31,023 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:31,024 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:31,024 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:31,025 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:12:31,026 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:12:31,026 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:12:31,027 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:12:31,027 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:12:31,028 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:12:31,028 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:12:31,029 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:12:31,029 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:12:31,030 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:12:31,031 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:31,031 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:31,032 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:31,032 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:31,033 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:31,033 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:31,034 DEBUG [Listener at jenkins-hbase4.apache.org/41077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:31,476 WARN [Listener at jenkins-hbase4.apache.org/41077] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:12:31,479 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 19:12:31,482 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 19:12:31,848 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:31,848 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:31,852 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0006_000001 (auth:SIMPLE) 2023-07-19 19:12:31,899 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0007_000001 (auth:SIMPLE) 2023-07-19 19:12:33,407 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:12:37,085 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0007_000001 (auth:SIMPLE) 2023-07-19 19:12:39,410 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0007_000001 (auth:SIMPLE) 2023-07-19 19:12:44,792 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843503_0007_000001 (auth:SIMPLE) 2023-07-19 19:12:46,758 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:12:46,758 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:12:46,789 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:46,789 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:12:46,790 INFO [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:12:46,790 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:46,790 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 19:12:46,790 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 19:12:46,791 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_192275424_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:46,791 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 19:12:46,791 DEBUG [Listener at jenkins-hbase4.apache.org/41077] snapshot.TestExportSnapshot(367): hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/export-test/export-1689793950838/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 19:12:46,802 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:46,803 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:46,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:46,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 19:12:46,809 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793966809"}]},"ts":"1689793966809"} 2023-07-19 19:12:46,810 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 19:12:46,812 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 19:12:46,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f959c10424becc459172b0a7d15be4a1, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0edbc0b4e76478c3c2f7217f76c10475, UNASSIGN}] 2023-07-19 19:12:46,819 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f959c10424becc459172b0a7d15be4a1, UNASSIGN 2023-07-19 19:12:46,819 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0edbc0b4e76478c3c2f7217f76c10475, UNASSIGN 2023-07-19 19:12:46,820 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f959c10424becc459172b0a7d15be4a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:12:46,820 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793966820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793966820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793966820"}]},"ts":"1689793966820"} 2023-07-19 19:12:46,820 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0edbc0b4e76478c3c2f7217f76c10475, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:12:46,820 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793966820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793966820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793966820"}]},"ts":"1689793966820"} 2023-07-19 19:12:46,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure f959c10424becc459172b0a7d15be4a1, server=jenkins-hbase4.apache.org,39767,1689793835630}] 2023-07-19 19:12:46,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 0edbc0b4e76478c3c2f7217f76c10475, server=jenkins-hbase4.apache.org,39881,1689793835575}] 2023-07-19 19:12:46,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 19:12:46,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:46,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f959c10424becc459172b0a7d15be4a1, disabling compactions & flushes 2023-07-19 19:12:46,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:46,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:46,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. after waiting 0 ms 2023-07-19 19:12:46,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:46,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:46,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0edbc0b4e76478c3c2f7217f76c10475, disabling compactions & flushes 2023-07-19 19:12:46,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:46,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:46,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. after waiting 0 ms 2023-07-19 19:12:46,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:46,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:46,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:46,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:46,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:46,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1. 2023-07-19 19:12:47,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475. 2023-07-19 19:12:47,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f959c10424becc459172b0a7d15be4a1: 2023-07-19 19:12:47,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0edbc0b4e76478c3c2f7217f76c10475: 2023-07-19 19:12:47,003 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f959c10424becc459172b0a7d15be4a1, regionState=CLOSED 2023-07-19 19:12:47,003 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793967003"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793967003"}]},"ts":"1689793967003"} 2023-07-19 19:12:47,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:47,004 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0edbc0b4e76478c3c2f7217f76c10475, regionState=CLOSED 2023-07-19 19:12:47,004 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793967004"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793967004"}]},"ts":"1689793967004"} 2023-07-19 19:12:47,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:47,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-19 19:12:47,008 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-19 19:12:47,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure f959c10424becc459172b0a7d15be4a1, server=jenkins-hbase4.apache.org,39767,1689793835630 in 183 msec 2023-07-19 19:12:47,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 0edbc0b4e76478c3c2f7217f76c10475, server=jenkins-hbase4.apache.org,39881,1689793835575 in 183 msec 2023-07-19 19:12:47,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0edbc0b4e76478c3c2f7217f76c10475, UNASSIGN in 193 msec 2023-07-19 19:12:47,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-19 19:12:47,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f959c10424becc459172b0a7d15be4a1, UNASSIGN in 193 msec 2023-07-19 19:12:47,012 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793967012"}]},"ts":"1689793967012"} 2023-07-19 19:12:47,014 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 19:12:47,016 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 19:12:47,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 214 msec 2023-07-19 19:12:47,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 19:12:47,112 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 19:12:47,113 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,119 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,121 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,125 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39881] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,128 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,128 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,128 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,128 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,129 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 19:12:47,129 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 19:12:47,129 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 19:12:47,129 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 19:12:47,132 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,132 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,132 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:47,132 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:47,132 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,132 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,132 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:47,132 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:47,135 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:47,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 19:12:47,143 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:47,144 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/recovered.edits] 2023-07-19 19:12:47,148 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/cf, FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/recovered.edits] 2023-07-19 19:12:47,150 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/cf/fdb48d67f85b482cb9506a8889a2bcce to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/cf/fdb48d67f85b482cb9506a8889a2bcce 2023-07-19 19:12:47,153 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/cf/d8acbe303ca14059b1b7ac1a6443d838 to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/cf/d8acbe303ca14059b1b7ac1a6443d838 2023-07-19 19:12:47,155 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1/recovered.edits/9.seqid 2023-07-19 19:12:47,156 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f959c10424becc459172b0a7d15be4a1 2023-07-19 19:12:47,157 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/recovered.edits/9.seqid to hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475/recovered.edits/9.seqid 2023-07-19 19:12:47,158 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0edbc0b4e76478c3c2f7217f76c10475 2023-07-19 19:12:47,158 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 19:12:47,161 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,167 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 19:12:47,169 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 19:12:47,170 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,171 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 19:12:47,171 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793967171"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:47,171 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793967171"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:47,176 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:12:47,177 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f959c10424becc459172b0a7d15be4a1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689793948075.f959c10424becc459172b0a7d15be4a1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0edbc0b4e76478c3c2f7217f76c10475, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793948075.0edbc0b4e76478c3c2f7217f76c10475.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:12:47,177 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 19:12:47,177 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793967177"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:47,186 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 19:12:47,190 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 77 msec 2023-07-19 19:12:47,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 19:12:47,237 INFO [Listener at jenkins-hbase4.apache.org/41077] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 19:12:47,247 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 19:12:47,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,250 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 19:12:47,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43163] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:47,291 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=769 (was 765) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1484584303_1 at /127.0.0.1:57448 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1484584303_1 at /127.0.0.1:38170 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:35544 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:38194 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5437 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_192275424_17 at /127.0.0.1:57478 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (145847449) connection to jenkins-hbase4.apache.org/172.31.14.131:35667 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36059dc5-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=679 (was 575) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=1374 (was 1800) 2023-07-19 19:12:47,291 WARN [Listener at jenkins-hbase4.apache.org/41077] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-19 19:12:47,291 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 19:12:47,308 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 19:12:47,424 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689793843503_0007_01_000001 is : 143 2023-07-19 19:12:52,588 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:13:01,438 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 19:13:15,566 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 19:13:15,567 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 19:13:15,685 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 19:13:15,712 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 19:13:15,714 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 19:13:15,741 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 19:13:15,849 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 19:13:15,849 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 19:13:15,849 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 19:13:15,849 INFO [Listener at jenkins-hbase4.apache.org/41077] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 19:13:15,850 DEBUG [Listener at jenkins-hbase4.apache.org/41077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f9eca1b to 127.0.0.1:50021 2023-07-19 19:13:15,850 DEBUG [Listener at jenkins-hbase4.apache.org/41077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:15,850 DEBUG [Listener at jenkins-hbase4.apache.org/41077] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 19:13:15,850 DEBUG [Listener at jenkins-hbase4.apache.org/41077] util.JVMClusterUtil(257): Found active master hash=875714014, stopped=false 2023-07-19 19:13:15,850 DEBUG [Listener at jenkins-hbase4.apache.org/41077] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:15,850 DEBUG [Listener at jenkins-hbase4.apache.org/41077] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 19:13:15,850 INFO [Listener at jenkins-hbase4.apache.org/41077] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:13:15,852 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 19:13:15,852 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 19:13:15,852 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 19:13:15,852 INFO [Listener at jenkins-hbase4.apache.org/41077] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 19:13:15,852 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 19:13:15,852 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:13:15,853 DEBUG [Listener at jenkins-hbase4.apache.org/41077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cdbbc26 to 127.0.0.1:50021 2023-07-19 19:13:15,853 DEBUG [Listener at jenkins-hbase4.apache.org/41077] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:15,853 INFO [Listener at jenkins-hbase4.apache.org/41077] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37775,1689793835515' ***** 2023-07-19 19:13:15,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:13:15,853 DEBUG [Listener at jenkins-hbase4.apache.org/41077] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:15,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:13:15,853 INFO [Listener at jenkins-hbase4.apache.org/41077] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 19:13:15,854 INFO [Listener at jenkins-hbase4.apache.org/41077] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39881,1689793835575' ***** 2023-07-19 19:13:15,854 DEBUG [Listener at jenkins-hbase4.apache.org/41077] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:15,854 INFO [Listener at jenkins-hbase4.apache.org/41077] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 19:13:15,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:13:15,854 INFO [Listener at jenkins-hbase4.apache.org/41077] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39767,1689793835630' ***** 2023-07-19 19:13:15,854 DEBUG [Listener at jenkins-hbase4.apache.org/41077] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:15,854 INFO [Listener at jenkins-hbase4.apache.org/41077] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 19:13:15,854 INFO [RS:0;jenkins-hbase4:37775] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 19:13:15,854 INFO [RS:1;jenkins-hbase4:39881] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 19:13:15,854 INFO [RS:2;jenkins-hbase4:39767] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 19:13:15,855 INFO [RS:2;jenkins-hbase4:39767] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 19:13:15,855 INFO [RS:2;jenkins-hbase4:39767] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 19:13:15,855 INFO [RS:1;jenkins-hbase4:39881] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 19:13:15,855 INFO [RS:1;jenkins-hbase4:39881] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 19:13:15,856 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(3305): Received CLOSE for 1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:13:15,856 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(3305): Received CLOSE for 02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:13:15,855 INFO [RS:0;jenkins-hbase4:37775] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 19:13:15,855 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 19:13:15,856 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 19:13:15,856 INFO [RS:0;jenkins-hbase4:37775] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 19:13:15,856 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:13:15,856 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 19:13:15,856 DEBUG [RS:0;jenkins-hbase4:37775] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c00055a to 127.0.0.1:50021 2023-07-19 19:13:15,856 DEBUG [RS:0;jenkins-hbase4:37775] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:15,856 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:13:15,861 DEBUG [RS:2;jenkins-hbase4:39767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55ca13ef to 127.0.0.1:50021 2023-07-19 19:13:15,861 DEBUG [RS:2;jenkins-hbase4:39767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:15,861 INFO [RS:0;jenkins-hbase4:37775] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 19:13:15,856 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:13:15,861 INFO [RS:0;jenkins-hbase4:37775] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 19:13:15,862 DEBUG [RS:1;jenkins-hbase4:39881] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a55e94d to 127.0.0.1:50021 2023-07-19 19:13:15,861 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 19:13:15,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:13:15,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 02bf08a6134737f44c9fcfba39b4ef7a, disabling compactions & flushes 2023-07-19 19:13:15,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b0b164eedb06b4681d87dbd042d0e35, disabling compactions & flushes 2023-07-19 19:13:15,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:13:15,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:13:15,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. after waiting 0 ms 2023-07-19 19:13:15,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:13:15,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 02bf08a6134737f44c9fcfba39b4ef7a 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 19:13:15,862 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1478): Online Regions={1b0b164eedb06b4681d87dbd042d0e35=hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35.} 2023-07-19 19:13:15,862 DEBUG [RS:1;jenkins-hbase4:39881] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:15,862 INFO [RS:0;jenkins-hbase4:37775] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 19:13:15,864 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 19:13:15,864 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1478): Online Regions={02bf08a6134737f44c9fcfba39b4ef7a=hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a.} 2023-07-19 19:13:15,864 DEBUG [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1504): Waiting on 1b0b164eedb06b4681d87dbd042d0e35 2023-07-19 19:13:15,865 DEBUG [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1504): Waiting on 02bf08a6134737f44c9fcfba39b4ef7a 2023-07-19 19:13:15,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:13:15,864 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 19:13:15,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:13:15,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. after waiting 0 ms 2023-07-19 19:13:15,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:13:15,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1b0b164eedb06b4681d87dbd042d0e35 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 19:13:15,866 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 19:13:15,866 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-19 19:13:15,869 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 19:13:15,870 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 19:13:15,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 19:13:15,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 19:13:15,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 19:13:15,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 19:13:15,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 19:13:15,921 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:15,923 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:15,924 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:15,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35/.tmp/info/b9fdabd13d854f91b50bcf06c63ec38e 2023-07-19 19:13:15,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a/.tmp/l/c061dcf226954f20ab1706a87631027c 2023-07-19 19:13:15,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c061dcf226954f20ab1706a87631027c 2023-07-19 19:13:15,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a/.tmp/l/c061dcf226954f20ab1706a87631027c as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a/l/c061dcf226954f20ab1706a87631027c 2023-07-19 19:13:15,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35/.tmp/info/b9fdabd13d854f91b50bcf06c63ec38e as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35/info/b9fdabd13d854f91b50bcf06c63ec38e 2023-07-19 19:13:15,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c061dcf226954f20ab1706a87631027c 2023-07-19 19:13:15,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a/l/c061dcf226954f20ab1706a87631027c, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 19:13:15,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 02bf08a6134737f44c9fcfba39b4ef7a in 122ms, sequenceid=18, compaction requested=false 2023-07-19 19:13:15,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35/info/b9fdabd13d854f91b50bcf06c63ec38e, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 19:13:15,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1b0b164eedb06b4681d87dbd042d0e35 in 122ms, sequenceid=6, compaction requested=false 2023-07-19 19:13:16,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/.tmp/info/aaf1caa7dead46caa2cc35559b0276cb 2023-07-19 19:13:16,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/acl/02bf08a6134737f44c9fcfba39b4ef7a/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 19:13:16,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aaf1caa7dead46caa2cc35559b0276cb 2023-07-19 19:13:16,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:16,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/namespace/1b0b164eedb06b4681d87dbd042d0e35/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:13:16,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:13:16,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 02bf08a6134737f44c9fcfba39b4ef7a: 2023-07-19 19:13:16,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689793839255.02bf08a6134737f44c9fcfba39b4ef7a. 2023-07-19 19:13:16,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:16,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:13:16,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b0b164eedb06b4681d87dbd042d0e35: 2023-07-19 19:13:16,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689793838392.1b0b164eedb06b4681d87dbd042d0e35. 2023-07-19 19:13:16,065 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39767,1689793835630; all regions closed. 2023-07-19 19:13:16,065 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39881,1689793835575; all regions closed. 2023-07-19 19:13:16,069 DEBUG [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 19:13:16,096 DEBUG [RS:1;jenkins-hbase4:39881] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/oldWALs 2023-07-19 19:13:16,096 INFO [RS:1;jenkins-hbase4:39881] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39881%2C1689793835575:(num 1689793837835) 2023-07-19 19:13:16,096 DEBUG [RS:1;jenkins-hbase4:39881] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:16,096 INFO [RS:1;jenkins-hbase4:39881] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:16,096 INFO [RS:1;jenkins-hbase4:39881] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 19:13:16,096 INFO [RS:1;jenkins-hbase4:39881] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 19:13:16,096 INFO [RS:1;jenkins-hbase4:39881] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 19:13:16,096 INFO [RS:1;jenkins-hbase4:39881] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 19:13:16,097 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 19:13:16,098 INFO [RS:1;jenkins-hbase4:39881] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39881 2023-07-19 19:13:16,099 DEBUG [RS:2;jenkins-hbase4:39767] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/oldWALs 2023-07-19 19:13:16,099 INFO [RS:2;jenkins-hbase4:39767] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39767%2C1689793835630:(num 1689793837827) 2023-07-19 19:13:16,100 DEBUG [RS:2;jenkins-hbase4:39767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:16,100 INFO [RS:2;jenkins-hbase4:39767] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:16,100 INFO [RS:2;jenkins-hbase4:39767] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 19:13:16,101 INFO [RS:2;jenkins-hbase4:39767] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 19:13:16,101 INFO [RS:2;jenkins-hbase4:39767] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 19:13:16,101 INFO [RS:2;jenkins-hbase4:39767] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 19:13:16,102 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 19:13:16,103 INFO [RS:2;jenkins-hbase4:39767] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39767 2023-07-19 19:13:16,108 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/.tmp/rep_barrier/c768f06f15574ddaafd0ffb277997b0b 2023-07-19 19:13:16,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:13:16,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:16,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:16,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:13:16,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39767,1689793835630 2023-07-19 19:13:16,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:16,110 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:16,112 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:13:16,112 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:13:16,112 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39881,1689793835575 2023-07-19 19:13:16,113 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39767,1689793835630] 2023-07-19 19:13:16,114 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39767,1689793835630; numProcessing=1 2023-07-19 19:13:16,116 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39767,1689793835630 already deleted, retry=false 2023-07-19 19:13:16,117 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39767,1689793835630 expired; onlineServers=2 2023-07-19 19:13:16,117 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39881,1689793835575] 2023-07-19 19:13:16,117 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39881,1689793835575; numProcessing=2 2023-07-19 19:13:16,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c768f06f15574ddaafd0ffb277997b0b 2023-07-19 19:13:16,153 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/.tmp/table/977917f87a33412d91ca9d4693ac72c5 2023-07-19 19:13:16,159 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 977917f87a33412d91ca9d4693ac72c5 2023-07-19 19:13:16,160 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/.tmp/info/aaf1caa7dead46caa2cc35559b0276cb as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/info/aaf1caa7dead46caa2cc35559b0276cb 2023-07-19 19:13:16,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aaf1caa7dead46caa2cc35559b0276cb 2023-07-19 19:13:16,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/info/aaf1caa7dead46caa2cc35559b0276cb, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 19:13:16,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/.tmp/rep_barrier/c768f06f15574ddaafd0ffb277997b0b as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/rep_barrier/c768f06f15574ddaafd0ffb277997b0b 2023-07-19 19:13:16,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c768f06f15574ddaafd0ffb277997b0b 2023-07-19 19:13:16,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/rep_barrier/c768f06f15574ddaafd0ffb277997b0b, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 19:13:16,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/.tmp/table/977917f87a33412d91ca9d4693ac72c5 as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/table/977917f87a33412d91ca9d4693ac72c5 2023-07-19 19:13:16,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 977917f87a33412d91ca9d4693ac72c5 2023-07-19 19:13:16,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/table/977917f87a33412d91ca9d4693ac72c5, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 19:13:16,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 328ms, sequenceid=131, compaction requested=false 2023-07-19 19:13:16,215 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:16,215 INFO [RS:1;jenkins-hbase4:39881] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39881,1689793835575; zookeeper connection closed. 2023-07-19 19:13:16,215 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39881-0x1017efe2b4a0002, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:16,215 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:16,215 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:39767-0x1017efe2b4a0003, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:16,215 INFO [RS:2;jenkins-hbase4:39767] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39767,1689793835630; zookeeper connection closed. 2023-07-19 19:13:16,216 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@45969c2c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@45969c2c 2023-07-19 19:13:16,217 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39881,1689793835575 already deleted, retry=false 2023-07-19 19:13:16,217 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39881,1689793835575 expired; onlineServers=1 2023-07-19 19:13:16,232 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@24c20e33] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@24c20e33 2023-07-19 19:13:16,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 19:13:16,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:16,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 19:13:16,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 19:13:16,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 19:13:16,236 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 19:13:16,269 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37775,1689793835515; all regions closed. 2023-07-19 19:13:16,281 DEBUG [RS:0;jenkins-hbase4:37775] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/oldWALs 2023-07-19 19:13:16,282 INFO [RS:0;jenkins-hbase4:37775] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37775%2C1689793835515.meta:.meta(num 1689793838037) 2023-07-19 19:13:16,290 DEBUG [RS:0;jenkins-hbase4:37775] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/oldWALs 2023-07-19 19:13:16,290 INFO [RS:0;jenkins-hbase4:37775] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37775%2C1689793835515:(num 1689793837818) 2023-07-19 19:13:16,290 DEBUG [RS:0;jenkins-hbase4:37775] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:16,291 INFO [RS:0;jenkins-hbase4:37775] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:16,291 INFO [RS:0;jenkins-hbase4:37775] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 19:13:16,291 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 19:13:16,292 INFO [RS:0;jenkins-hbase4:37775] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37775 2023-07-19 19:13:16,294 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37775,1689793835515 2023-07-19 19:13:16,294 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:16,296 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37775,1689793835515] 2023-07-19 19:13:16,296 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37775,1689793835515; numProcessing=3 2023-07-19 19:13:16,298 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37775,1689793835515 already deleted, retry=false 2023-07-19 19:13:16,298 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37775,1689793835515 expired; onlineServers=0 2023-07-19 19:13:16,298 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43163,1689793834027' ***** 2023-07-19 19:13:16,298 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 19:13:16,299 DEBUG [M:0;jenkins-hbase4:43163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@750f5fe5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 19:13:16,299 INFO [M:0;jenkins-hbase4:43163] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43163,1689793834027 2023-07-19 19:13:16,299 INFO [M:0;jenkins-hbase4:43163] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43163,1689793834027; all regions closed. 2023-07-19 19:13:16,299 DEBUG [M:0;jenkins-hbase4:43163] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:16,299 DEBUG [M:0;jenkins-hbase4:43163] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 19:13:16,299 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 19:13:16,299 DEBUG [M:0;jenkins-hbase4:43163] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 19:13:16,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689793837290] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689793837290,5,FailOnTimeoutGroup] 2023-07-19 19:13:16,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689793837291] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689793837291,5,FailOnTimeoutGroup] 2023-07-19 19:13:16,299 INFO [M:0;jenkins-hbase4:43163] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 19:13:16,299 INFO [M:0;jenkins-hbase4:43163] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 19:13:16,299 INFO [M:0;jenkins-hbase4:43163] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 19:13:16,300 DEBUG [M:0;jenkins-hbase4:43163] master.HMaster(1512): Stopping service threads 2023-07-19 19:13:16,300 INFO [M:0;jenkins-hbase4:43163] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 19:13:16,300 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 19:13:16,300 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:13:16,300 ERROR [M:0;jenkins-hbase4:43163] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 19:13:16,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:13:16,301 INFO [M:0;jenkins-hbase4:43163] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 19:13:16,301 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 19:13:16,302 DEBUG [M:0;jenkins-hbase4:43163] zookeeper.ZKUtil(398): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 19:13:16,302 WARN [M:0;jenkins-hbase4:43163] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 19:13:16,302 INFO [M:0;jenkins-hbase4:43163] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 19:13:16,302 INFO [M:0;jenkins-hbase4:43163] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 19:13:16,303 DEBUG [M:0;jenkins-hbase4:43163] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 19:13:16,303 INFO [M:0;jenkins-hbase4:43163] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:13:16,303 DEBUG [M:0;jenkins-hbase4:43163] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:13:16,303 DEBUG [M:0;jenkins-hbase4:43163] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 19:13:16,303 DEBUG [M:0;jenkins-hbase4:43163] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:13:16,303 INFO [M:0;jenkins-hbase4:43163] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.36 KB heapSize=449.55 KB 2023-07-19 19:13:16,350 INFO [M:0;jenkins-hbase4:43163] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.36 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/20664132483e44d7b009ef3f370fbebd 2023-07-19 19:13:16,355 INFO [M:0;jenkins-hbase4:43163] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20664132483e44d7b009ef3f370fbebd 2023-07-19 19:13:16,359 DEBUG [M:0;jenkins-hbase4:43163] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/20664132483e44d7b009ef3f370fbebd as hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/20664132483e44d7b009ef3f370fbebd 2023-07-19 19:13:16,365 INFO [M:0;jenkins-hbase4:43163] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20664132483e44d7b009ef3f370fbebd 2023-07-19 19:13:16,365 INFO [M:0;jenkins-hbase4:43163] regionserver.HStore(1080): Added hdfs://localhost:39651/user/jenkins/test-data/e52b9218-3552-cda3-2244-1a0b2bcc50f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/20664132483e44d7b009ef3f370fbebd, entries=119, sequenceid=899, filesize=28.5 K 2023-07-19 19:13:16,367 INFO [M:0;jenkins-hbase4:43163] regionserver.HRegion(2948): Finished flush of dataSize ~373.36 KB/382325, heapSize ~449.53 KB/460320, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 63ms, sequenceid=899, compaction requested=false 2023-07-19 19:13:16,397 INFO [RS:0;jenkins-hbase4:37775] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37775,1689793835515; zookeeper connection closed. 2023-07-19 19:13:16,397 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:16,397 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): regionserver:37775-0x1017efe2b4a0001, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:16,397 INFO [M:0;jenkins-hbase4:43163] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:13:16,397 DEBUG [M:0;jenkins-hbase4:43163] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 19:13:16,398 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@242f7787] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@242f7787 2023-07-19 19:13:16,398 INFO [Listener at jenkins-hbase4.apache.org/41077] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 19:13:16,408 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 19:13:16,408 INFO [M:0;jenkins-hbase4:43163] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 19:13:16,409 INFO [M:0;jenkins-hbase4:43163] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43163 2023-07-19 19:13:16,411 DEBUG [M:0;jenkins-hbase4:43163] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43163,1689793834027 already deleted, retry=false 2023-07-19 19:13:16,513 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:16,513 DEBUG [Listener at localhost/40019-EventThread] zookeeper.ZKWatcher(600): master:43163-0x1017efe2b4a0000, quorum=127.0.0.1:50021, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:16,513 INFO [M:0;jenkins-hbase4:43163] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43163,1689793834027; zookeeper connection closed. 2023-07-19 19:13:16,515 WARN [Listener at jenkins-hbase4.apache.org/41077] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 19:13:16,529 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 19:13:16,634 WARN [BP-273514559-172.31.14.131-1689793829890 heartbeating to localhost/127.0.0.1:39651] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 19:13:16,634 WARN [BP-273514559-172.31.14.131-1689793829890 heartbeating to localhost/127.0.0.1:39651] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-273514559-172.31.14.131-1689793829890 (Datanode Uuid 58694873-425c-4962-ad55-d50fca77907d) service to localhost/127.0.0.1:39651 2023-07-19 19:13:16,636 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data5/current/BP-273514559-172.31.14.131-1689793829890] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:16,636 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data6/current/BP-273514559-172.31.14.131-1689793829890] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:16,638 WARN [Listener at jenkins-hbase4.apache.org/41077] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 19:13:16,642 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 19:13:16,746 WARN [BP-273514559-172.31.14.131-1689793829890 heartbeating to localhost/127.0.0.1:39651] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 19:13:16,746 WARN [BP-273514559-172.31.14.131-1689793829890 heartbeating to localhost/127.0.0.1:39651] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-273514559-172.31.14.131-1689793829890 (Datanode Uuid ea9afea5-8c2f-4e9e-999f-876ec8efc119) service to localhost/127.0.0.1:39651 2023-07-19 19:13:16,747 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data3/current/BP-273514559-172.31.14.131-1689793829890] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:16,747 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data4/current/BP-273514559-172.31.14.131-1689793829890] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:16,749 WARN [Listener at jenkins-hbase4.apache.org/41077] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 19:13:16,751 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 19:13:16,855 WARN [BP-273514559-172.31.14.131-1689793829890 heartbeating to localhost/127.0.0.1:39651] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 19:13:16,855 WARN [BP-273514559-172.31.14.131-1689793829890 heartbeating to localhost/127.0.0.1:39651] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-273514559-172.31.14.131-1689793829890 (Datanode Uuid 1e243d81-5594-4f84-aeb3-0793ec2c6f92) service to localhost/127.0.0.1:39651 2023-07-19 19:13:16,856 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data1/current/BP-273514559-172.31.14.131-1689793829890] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:16,856 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f53b68eb-ccf5-5e81-c89b-1667e2c424ab/cluster_89319614-6045-d998-1c1e-10f34a1d352e/dfs/data/data2/current/BP-273514559-172.31.14.131-1689793829890] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:16,882 INFO [Listener at jenkins-hbase4.apache.org/41077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 19:13:17,008 INFO [Listener at jenkins-hbase4.apache.org/41077] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 19:13:17,123 INFO [Listener at jenkins-hbase4.apache.org/41077] hbase.HBaseTestingUtility(1293): Minicluster is down