2023-07-19 15:10:09,336 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 15:10:09,604 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134 2023-07-19 15:10:09,604 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-19 15:10:09,604 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-19 15:10:09,650 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 15:10:09,933 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 15:10:09,934 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25, deleteOnExit=true 2023-07-19 15:10:09,934 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 15:10:09,935 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/test.cache.data in system properties and HBase conf 2023-07-19 15:10:09,935 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 15:10:09,936 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop.log.dir in system properties and HBase conf 2023-07-19 15:10:09,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 15:10:09,937 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 15:10:09,937 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 15:10:10,337 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 15:10:10,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 15:10:10,346 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 15:10:10,346 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 15:10:10,347 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 15:10:10,347 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 15:10:10,348 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 15:10:10,348 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 15:10:10,349 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 15:10:10,349 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 15:10:10,349 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/nfs.dump.dir in system properties and HBase conf 2023-07-19 15:10:10,350 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir in system properties and HBase conf 2023-07-19 15:10:10,350 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 15:10:10,351 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 15:10:10,351 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 15:10:11,087 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 15:10:11,092 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 15:10:11,430 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 15:10:11,637 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 15:10:11,656 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 15:10:11,705 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 15:10:11,749 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir/Jetty_localhost_33855_hdfs____7ic9b6/webapp 2023-07-19 15:10:11,958 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33855 2023-07-19 15:10:12,010 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 15:10:12,010 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 15:10:12,585 WARN [Listener at localhost/44363] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 15:10:12,720 WARN [Listener at localhost/44363] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 15:10:12,753 WARN [Listener at localhost/44363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 15:10:12,762 INFO [Listener at localhost/44363] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 15:10:12,773 INFO [Listener at localhost/44363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir/Jetty_localhost_39459_datanode____1vau1/webapp 2023-07-19 15:10:12,941 INFO [Listener at localhost/44363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39459 2023-07-19 15:10:13,550 WARN [Listener at localhost/36811] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 15:10:13,584 WARN [Listener at localhost/36811] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 15:10:13,592 WARN [Listener at localhost/36811] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 15:10:13,595 INFO [Listener at localhost/36811] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 15:10:13,609 INFO [Listener at localhost/36811] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir/Jetty_localhost_44697_datanode____jqrvwb/webapp 2023-07-19 15:10:13,728 INFO [Listener at localhost/36811] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44697 2023-07-19 15:10:13,754 WARN [Listener at localhost/45007] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 15:10:13,808 WARN [Listener at localhost/45007] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 15:10:13,818 WARN [Listener at localhost/45007] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 15:10:13,821 INFO [Listener at localhost/45007] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 15:10:13,827 INFO [Listener at localhost/45007] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir/Jetty_localhost_44029_datanode____.9zumci/webapp 2023-07-19 15:10:13,977 INFO [Listener at localhost/45007] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44029 2023-07-19 15:10:14,002 WARN [Listener at localhost/42995] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 15:10:14,364 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9d0d6878b6aa5d6a: Processing first storage report for DS-034518eb-80e5-4617-b082-3cecf78f3f67 from datanode f06f41f9-9c3c-487e-9965-9c3b387fa5c2 2023-07-19 15:10:14,366 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9d0d6878b6aa5d6a: from storage DS-034518eb-80e5-4617-b082-3cecf78f3f67 node DatanodeRegistration(127.0.0.1:44573, datanodeUuid=f06f41f9-9c3c-487e-9965-9c3b387fa5c2, infoPort=39337, infoSecurePort=0, ipcPort=45007, storageInfo=lv=-57;cid=testClusterID;nsid=164438345;c=1689779411180), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 15:10:14,367 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4461575e9b587155: Processing first storage report for DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d from datanode 0d8a5728-1f78-4aaf-b1bf-f5d1b2ec118a 2023-07-19 15:10:14,368 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4461575e9b587155: from storage DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d node DatanodeRegistration(127.0.0.1:44055, datanodeUuid=0d8a5728-1f78-4aaf-b1bf-f5d1b2ec118a, infoPort=36749, infoSecurePort=0, ipcPort=36811, storageInfo=lv=-57;cid=testClusterID;nsid=164438345;c=1689779411180), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 15:10:14,368 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9d0d6878b6aa5d6a: Processing first storage report for DS-eef173a7-92d9-47f7-96f2-76b8b4865fbf from datanode f06f41f9-9c3c-487e-9965-9c3b387fa5c2 2023-07-19 15:10:14,368 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9d0d6878b6aa5d6a: from storage DS-eef173a7-92d9-47f7-96f2-76b8b4865fbf node DatanodeRegistration(127.0.0.1:44573, datanodeUuid=f06f41f9-9c3c-487e-9965-9c3b387fa5c2, infoPort=39337, infoSecurePort=0, ipcPort=45007, storageInfo=lv=-57;cid=testClusterID;nsid=164438345;c=1689779411180), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 15:10:14,368 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4461575e9b587155: Processing first storage report for DS-1f6c98c2-e3b5-4435-9ea7-de5b2dce67b2 from datanode 0d8a5728-1f78-4aaf-b1bf-f5d1b2ec118a 2023-07-19 15:10:14,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4461575e9b587155: from storage DS-1f6c98c2-e3b5-4435-9ea7-de5b2dce67b2 node DatanodeRegistration(127.0.0.1:44055, datanodeUuid=0d8a5728-1f78-4aaf-b1bf-f5d1b2ec118a, infoPort=36749, infoSecurePort=0, ipcPort=36811, storageInfo=lv=-57;cid=testClusterID;nsid=164438345;c=1689779411180), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 15:10:14,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3d1d36a01b872546: Processing first storage report for DS-fd93563b-31fc-4e32-873e-d0d666881bf2 from datanode 720bed41-b1a2-4ebd-91d3-f3ef54e26928 2023-07-19 15:10:14,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3d1d36a01b872546: from storage DS-fd93563b-31fc-4e32-873e-d0d666881bf2 node DatanodeRegistration(127.0.0.1:45951, datanodeUuid=720bed41-b1a2-4ebd-91d3-f3ef54e26928, infoPort=36685, infoSecurePort=0, ipcPort=42995, storageInfo=lv=-57;cid=testClusterID;nsid=164438345;c=1689779411180), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 15:10:14,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3d1d36a01b872546: Processing first storage report for DS-3e88ae82-d73f-47cf-8481-28cf00faec49 from datanode 720bed41-b1a2-4ebd-91d3-f3ef54e26928 2023-07-19 15:10:14,370 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3d1d36a01b872546: from storage DS-3e88ae82-d73f-47cf-8481-28cf00faec49 node DatanodeRegistration(127.0.0.1:45951, datanodeUuid=720bed41-b1a2-4ebd-91d3-f3ef54e26928, infoPort=36685, infoSecurePort=0, ipcPort=42995, storageInfo=lv=-57;cid=testClusterID;nsid=164438345;c=1689779411180), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 15:10:14,639 DEBUG [Listener at localhost/42995] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134 2023-07-19 15:10:14,767 INFO [Listener at localhost/42995] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/zookeeper_0, clientPort=52285, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 15:10:14,796 INFO [Listener at localhost/42995] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52285 2023-07-19 15:10:14,806 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:14,810 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:15,534 INFO [Listener at localhost/42995] util.FSUtils(471): Created version file at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 with version=8 2023-07-19 15:10:15,534 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/hbase-staging 2023-07-19 15:10:15,913 INFO [Listener at localhost/42995] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 15:10:16,536 INFO [Listener at localhost/42995] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 15:10:16,569 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:16,570 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:16,570 INFO [Listener at localhost/42995] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 15:10:16,570 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:16,570 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 15:10:16,730 INFO [Listener at localhost/42995] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 15:10:16,819 DEBUG [Listener at localhost/42995] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 15:10:16,919 INFO [Listener at localhost/42995] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42601 2023-07-19 15:10:16,935 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:16,938 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:16,968 INFO [Listener at localhost/42995] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42601 connecting to ZooKeeper ensemble=127.0.0.1:52285 2023-07-19 15:10:17,039 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:426010x0, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 15:10:17,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42601-0x1017e2229d90000 connected 2023-07-19 15:10:17,101 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 15:10:17,102 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 15:10:17,119 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 15:10:17,131 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42601 2023-07-19 15:10:17,132 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42601 2023-07-19 15:10:17,133 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42601 2023-07-19 15:10:17,134 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42601 2023-07-19 15:10:17,135 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42601 2023-07-19 15:10:17,143 INFO [Listener at localhost/42995] master.HMaster(444): hbase.rootdir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983, hbase.cluster.distributed=false 2023-07-19 15:10:17,219 INFO [Listener at localhost/42995] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 15:10:17,219 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:17,219 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:17,220 INFO [Listener at localhost/42995] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 15:10:17,220 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:17,220 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 15:10:17,226 INFO [Listener at localhost/42995] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 15:10:17,231 INFO [Listener at localhost/42995] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37001 2023-07-19 15:10:17,235 INFO [Listener at localhost/42995] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 15:10:17,242 INFO [Listener at localhost/42995] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 15:10:17,243 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:17,246 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:17,248 INFO [Listener at localhost/42995] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37001 connecting to ZooKeeper ensemble=127.0.0.1:52285 2023-07-19 15:10:17,256 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:370010x0, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 15:10:17,257 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): regionserver:370010x0, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 15:10:17,259 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): regionserver:370010x0, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 15:10:17,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37001-0x1017e2229d90001 connected 2023-07-19 15:10:17,260 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 15:10:17,261 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37001 2023-07-19 15:10:17,263 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37001 2023-07-19 15:10:17,266 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37001 2023-07-19 15:10:17,266 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37001 2023-07-19 15:10:17,268 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37001 2023-07-19 15:10:17,286 INFO [Listener at localhost/42995] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 15:10:17,286 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:17,286 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:17,287 INFO [Listener at localhost/42995] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 15:10:17,287 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:17,287 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 15:10:17,287 INFO [Listener at localhost/42995] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 15:10:17,294 INFO [Listener at localhost/42995] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44923 2023-07-19 15:10:17,294 INFO [Listener at localhost/42995] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 15:10:17,295 INFO [Listener at localhost/42995] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 15:10:17,296 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:17,299 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:17,301 INFO [Listener at localhost/42995] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44923 connecting to ZooKeeper ensemble=127.0.0.1:52285 2023-07-19 15:10:17,318 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:449230x0, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 15:10:17,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44923-0x1017e2229d90002 connected 2023-07-19 15:10:17,319 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 15:10:17,320 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 15:10:17,321 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 15:10:17,327 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44923 2023-07-19 15:10:17,328 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44923 2023-07-19 15:10:17,335 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44923 2023-07-19 15:10:17,337 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44923 2023-07-19 15:10:17,338 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44923 2023-07-19 15:10:17,351 INFO [Listener at localhost/42995] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 15:10:17,351 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:17,352 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:17,352 INFO [Listener at localhost/42995] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 15:10:17,352 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 15:10:17,352 INFO [Listener at localhost/42995] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 15:10:17,352 INFO [Listener at localhost/42995] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 15:10:17,355 INFO [Listener at localhost/42995] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43149 2023-07-19 15:10:17,356 INFO [Listener at localhost/42995] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 15:10:17,359 INFO [Listener at localhost/42995] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 15:10:17,360 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:17,362 INFO [Listener at localhost/42995] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:17,363 INFO [Listener at localhost/42995] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43149 connecting to ZooKeeper ensemble=127.0.0.1:52285 2023-07-19 15:10:17,368 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:431490x0, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 15:10:17,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43149-0x1017e2229d90003 connected 2023-07-19 15:10:17,369 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 15:10:17,370 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 15:10:17,371 DEBUG [Listener at localhost/42995] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 15:10:17,378 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43149 2023-07-19 15:10:17,382 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43149 2023-07-19 15:10:17,383 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43149 2023-07-19 15:10:17,386 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43149 2023-07-19 15:10:17,386 DEBUG [Listener at localhost/42995] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43149 2023-07-19 15:10:17,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:10:17,398 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 15:10:17,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:10:17,427 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 15:10:17,427 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 15:10:17,427 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 15:10:17,428 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:10:17,427 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 15:10:17,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 15:10:17,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42601,1689779415712 from backup master directory 2023-07-19 15:10:17,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 15:10:17,436 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:10:17,436 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 15:10:17,437 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 15:10:17,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:10:17,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 15:10:17,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 15:10:17,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/hbase.id with ID: e21bf6e4-0035-4264-81a3-9552414178ec 2023-07-19 15:10:17,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 15:10:17,641 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:10:17,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7342e769 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:17,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b93d6bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:17,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 15:10:17,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 15:10:17,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 15:10:17,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 15:10:17,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 15:10:17,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 15:10:17,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 15:10:17,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/data/master/store-tmp 2023-07-19 15:10:17,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:17,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 15:10:17,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 15:10:17,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 15:10:17,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 15:10:17,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 15:10:17,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 15:10:17,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 15:10:17,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/WALs/jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:10:17,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42601%2C1689779415712, suffix=, logDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/WALs/jenkins-hbase4.apache.org,42601,1689779415712, archiveDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/oldWALs, maxLogs=10 2023-07-19 15:10:18,029 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK] 2023-07-19 15:10:18,029 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK] 2023-07-19 15:10:18,027 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK] 2023-07-19 15:10:18,038 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 15:10:18,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/WALs/jenkins-hbase4.apache.org,42601,1689779415712/jenkins-hbase4.apache.org%2C42601%2C1689779415712.1689779417961 2023-07-19 15:10:18,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK], DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK], DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK]] 2023-07-19 15:10:18,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 15:10:18,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:18,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 15:10:18,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 15:10:18,241 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 15:10:18,249 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 15:10:18,288 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 15:10:18,303 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:18,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 15:10:18,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 15:10:18,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 15:10:18,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:10:18,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62351310, jitterRate=-0.07089307904243469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:10:18,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 15:10:18,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 15:10:18,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 15:10:18,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 15:10:18,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 15:10:18,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 15:10:18,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-07-19 15:10:18,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 15:10:18,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 15:10:18,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 15:10:18,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 15:10:18,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 15:10:18,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 15:10:18,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 15:10:18,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 15:10:18,519 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:10:18,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 15:10:18,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 15:10:18,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 15:10:18,544 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 15:10:18,544 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 15:10:18,544 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 15:10:18,545 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 15:10:18,545 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:10:18,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42601,1689779415712, sessionid=0x1017e2229d90000, setting cluster-up flag (Was=false) 2023-07-19 15:10:18,568 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:10:18,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 15:10:18,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:10:18,583 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:10:18,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 15:10:18,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:10:18,592 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp 2023-07-19 15:10:18,697 INFO [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(951): ClusterId : e21bf6e4-0035-4264-81a3-9552414178ec 2023-07-19 15:10:18,709 INFO [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(951): ClusterId : e21bf6e4-0035-4264-81a3-9552414178ec 2023-07-19 15:10:18,711 INFO [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(951): ClusterId : e21bf6e4-0035-4264-81a3-9552414178ec 2023-07-19 15:10:18,714 DEBUG [RS:1;jenkins-hbase4:44923] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 15:10:18,714 DEBUG [RS:2;jenkins-hbase4:43149] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 15:10:18,714 DEBUG [RS:0;jenkins-hbase4:37001] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 15:10:18,724 DEBUG [RS:1;jenkins-hbase4:44923] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 15:10:18,724 DEBUG [RS:1;jenkins-hbase4:44923] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 15:10:18,724 DEBUG [RS:0;jenkins-hbase4:37001] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 15:10:18,724 DEBUG [RS:0;jenkins-hbase4:37001] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 15:10:18,725 DEBUG [RS:2;jenkins-hbase4:43149] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 15:10:18,725 DEBUG [RS:2;jenkins-hbase4:43149] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 15:10:18,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 15:10:18,729 DEBUG [RS:0;jenkins-hbase4:37001] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 15:10:18,734 DEBUG [RS:1;jenkins-hbase4:44923] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 15:10:18,735 DEBUG [RS:0;jenkins-hbase4:37001] zookeeper.ReadOnlyZKClient(139): Connect 0x4458162a to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:18,737 DEBUG [RS:2;jenkins-hbase4:43149] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 15:10:18,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:18,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 15:10:18,748 DEBUG [RS:1;jenkins-hbase4:44923] zookeeper.ReadOnlyZKClient(139): Connect 0x3ec33ceb to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:18,755 DEBUG [RS:2;jenkins-hbase4:43149] zookeeper.ReadOnlyZKClient(139): Connect 0x4c7e15f9 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:18,788 DEBUG [RS:0;jenkins-hbase4:37001] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a9ff0d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:18,789 DEBUG [RS:0;jenkins-hbase4:37001] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ea07d5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 15:10:18,790 DEBUG [RS:2;jenkins-hbase4:43149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42b9f206, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:18,791 DEBUG [RS:2;jenkins-hbase4:43149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46867e89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 15:10:18,832 DEBUG [RS:1;jenkins-hbase4:44923] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3004c543, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:18,833 DEBUG [RS:1;jenkins-hbase4:44923] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7139cf78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 15:10:18,857 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43149 2023-07-19 15:10:18,864 INFO [RS:2;jenkins-hbase4:43149] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 15:10:18,864 INFO [RS:2;jenkins-hbase4:43149] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 15:10:18,864 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 15:10:18,865 INFO [RS:2;jenkins-hbase4:43149] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:18,866 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 15:10:18,867 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37001 2023-07-19 15:10:18,868 INFO [RS:0;jenkins-hbase4:37001] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 15:10:18,868 INFO [RS:0;jenkins-hbase4:37001] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 15:10:18,868 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 15:10:18,869 INFO [RS:0;jenkins-hbase4:37001] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:18,869 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 15:10:18,871 INFO [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42601,1689779415712 with isa=jenkins-hbase4.apache.org/172.31.14.131:43149, startcode=1689779417350 2023-07-19 15:10:18,871 INFO [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42601,1689779415712 with isa=jenkins-hbase4.apache.org/172.31.14.131:37001, startcode=1689779417218 2023-07-19 15:10:18,869 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44923 2023-07-19 15:10:18,872 INFO [RS:1;jenkins-hbase4:44923] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 15:10:18,872 INFO [RS:1;jenkins-hbase4:44923] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 15:10:18,872 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 15:10:18,872 INFO [RS:1;jenkins-hbase4:44923] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:18,872 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 15:10:18,873 INFO [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42601,1689779415712 with isa=jenkins-hbase4.apache.org/172.31.14.131:44923, startcode=1689779417285 2023-07-19 15:10:18,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 15:10:18,896 DEBUG [RS:1;jenkins-hbase4:44923] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 15:10:18,896 DEBUG [RS:0;jenkins-hbase4:37001] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 15:10:18,896 DEBUG [RS:2;jenkins-hbase4:43149] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 15:10:18,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 15:10:18,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 15:10:18,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 15:10:18,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 15:10:18,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 15:10:18,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:18,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 15:10:18,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:18,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689779448912 2023-07-19 15:10:18,919 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 15:10:18,920 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 15:10:18,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 15:10:18,927 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 15:10:18,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 15:10:18,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 15:10:18,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 15:10:18,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 15:10:18,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 15:10:18,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:18,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 15:10:18,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 15:10:18,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 15:10:18,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 15:10:18,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 15:10:18,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689779418977,5,FailOnTimeoutGroup] 2023-07-19 15:10:18,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689779418987,5,FailOnTimeoutGroup] 2023-07-19 15:10:18,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:18,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 15:10:18,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:18,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,014 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48299, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 15:10:19,024 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50141, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 15:10:19,014 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51349, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 15:10:19,046 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42601] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:19,066 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 15:10:19,068 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 15:10:19,069 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:10:19,070 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42601] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:19,071 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42601] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:19,082 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:10:19,083 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44363 2023-07-19 15:10:19,083 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 15:10:19,083 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:10:19,084 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44363 2023-07-19 15:10:19,084 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 15:10:19,085 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:10:19,086 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44363 2023-07-19 15:10:19,086 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 15:10:19,093 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 15:10:19,094 DEBUG [RS:2;jenkins-hbase4:43149] zookeeper.ZKUtil(162): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:19,094 DEBUG [RS:0;jenkins-hbase4:37001] zookeeper.ZKUtil(162): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:19,094 WARN [RS:2;jenkins-hbase4:43149] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 15:10:19,095 WARN [RS:0;jenkins-hbase4:37001] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 15:10:19,095 INFO [RS:2;jenkins-hbase4:43149] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 15:10:19,098 DEBUG [RS:1;jenkins-hbase4:44923] zookeeper.ZKUtil(162): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:19,098 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:19,099 WARN [RS:1;jenkins-hbase4:44923] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 15:10:19,099 INFO [RS:1;jenkins-hbase4:44923] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 15:10:19,099 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:19,095 INFO [RS:0;jenkins-hbase4:37001] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 15:10:19,099 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44923,1689779417285] 2023-07-19 15:10:19,099 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:19,099 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43149,1689779417350] 2023-07-19 15:10:19,100 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37001,1689779417218] 2023-07-19 15:10:19,142 DEBUG [RS:2;jenkins-hbase4:43149] zookeeper.ZKUtil(162): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:19,142 DEBUG [RS:1;jenkins-hbase4:44923] zookeeper.ZKUtil(162): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:19,143 DEBUG [RS:2;jenkins-hbase4:43149] zookeeper.ZKUtil(162): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:19,143 DEBUG [RS:0;jenkins-hbase4:37001] zookeeper.ZKUtil(162): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:19,143 DEBUG [RS:1;jenkins-hbase4:44923] zookeeper.ZKUtil(162): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:19,144 DEBUG [RS:0;jenkins-hbase4:37001] zookeeper.ZKUtil(162): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:19,144 DEBUG [RS:2;jenkins-hbase4:43149] zookeeper.ZKUtil(162): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:19,145 DEBUG [RS:1;jenkins-hbase4:44923] zookeeper.ZKUtil(162): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:19,145 DEBUG [RS:0;jenkins-hbase4:37001] zookeeper.ZKUtil(162): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:19,151 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:19,161 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 15:10:19,162 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 15:10:19,161 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 15:10:19,161 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 15:10:19,165 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/info 2023-07-19 15:10:19,166 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 15:10:19,167 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:19,167 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 15:10:19,171 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/rep_barrier 2023-07-19 15:10:19,171 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 15:10:19,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:19,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 15:10:19,176 INFO [RS:2;jenkins-hbase4:43149] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 15:10:19,178 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/table 2023-07-19 15:10:19,179 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 15:10:19,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:19,193 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740 2023-07-19 15:10:19,192 INFO [RS:1;jenkins-hbase4:44923] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 15:10:19,192 INFO [RS:0;jenkins-hbase4:37001] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 15:10:19,206 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740 2023-07-19 15:10:19,211 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 15:10:19,218 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 15:10:19,237 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:10:19,238 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59119428, jitterRate=-0.11905187368392944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 15:10:19,238 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 15:10:19,238 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 15:10:19,238 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 15:10:19,238 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 15:10:19,239 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 15:10:19,239 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 15:10:19,240 INFO [RS:0;jenkins-hbase4:37001] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 15:10:19,240 INFO [RS:1;jenkins-hbase4:44923] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 15:10:19,240 INFO [RS:2;jenkins-hbase4:43149] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 15:10:19,241 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 15:10:19,241 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 15:10:19,247 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 15:10:19,247 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 15:10:19,297 INFO [RS:1;jenkins-hbase4:44923] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 15:10:19,298 INFO [RS:1;jenkins-hbase4:44923] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 15:10:19,307 INFO [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 15:10:19,298 INFO [RS:0;jenkins-hbase4:37001] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 15:10:19,307 INFO [RS:2;jenkins-hbase4:43149] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 15:10:19,312 INFO [RS:2;jenkins-hbase4:43149] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,313 INFO [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 15:10:19,310 INFO [RS:0;jenkins-hbase4:37001] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,322 INFO [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 15:10:19,334 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 15:10:19,338 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 15:10:19,340 INFO [RS:0;jenkins-hbase4:37001] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,340 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,340 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,340 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,340 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,341 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,341 INFO [RS:2;jenkins-hbase4:43149] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,341 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 15:10:19,341 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,341 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,344 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,344 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,344 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,344 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,344 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 15:10:19,344 INFO [RS:1;jenkins-hbase4:44923] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,344 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,345 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,345 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,345 DEBUG [RS:2;jenkins-hbase4:43149] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,345 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,345 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,346 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,346 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,347 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,347 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,347 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 15:10:19,347 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,347 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,347 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,347 DEBUG [RS:1;jenkins-hbase4:44923] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,346 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,348 DEBUG [RS:0;jenkins-hbase4:37001] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 15:10:19,357 INFO [RS:2;jenkins-hbase4:43149] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,357 INFO [RS:2;jenkins-hbase4:43149] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,357 INFO [RS:2;jenkins-hbase4:43149] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,371 INFO [RS:1;jenkins-hbase4:44923] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,371 INFO [RS:1;jenkins-hbase4:44923] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,371 INFO [RS:1;jenkins-hbase4:44923] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,378 INFO [RS:0;jenkins-hbase4:37001] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,379 INFO [RS:0;jenkins-hbase4:37001] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,379 INFO [RS:0;jenkins-hbase4:37001] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,386 INFO [RS:2;jenkins-hbase4:43149] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 15:10:19,390 INFO [RS:2;jenkins-hbase4:43149] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43149,1689779417350-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,397 INFO [RS:1;jenkins-hbase4:44923] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 15:10:19,398 INFO [RS:1;jenkins-hbase4:44923] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44923,1689779417285-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,398 INFO [RS:0;jenkins-hbase4:37001] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 15:10:19,398 INFO [RS:0;jenkins-hbase4:37001] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37001,1689779417218-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:19,413 INFO [RS:2;jenkins-hbase4:43149] regionserver.Replication(203): jenkins-hbase4.apache.org,43149,1689779417350 started 2023-07-19 15:10:19,413 INFO [RS:0;jenkins-hbase4:37001] regionserver.Replication(203): jenkins-hbase4.apache.org,37001,1689779417218 started 2023-07-19 15:10:19,414 INFO [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43149,1689779417350, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43149, sessionid=0x1017e2229d90003 2023-07-19 15:10:19,414 INFO [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37001,1689779417218, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37001, sessionid=0x1017e2229d90001 2023-07-19 15:10:19,414 DEBUG [RS:2;jenkins-hbase4:43149] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 15:10:19,414 DEBUG [RS:0;jenkins-hbase4:37001] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 15:10:19,414 DEBUG [RS:2;jenkins-hbase4:43149] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:19,414 DEBUG [RS:0;jenkins-hbase4:37001] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:19,415 DEBUG [RS:2;jenkins-hbase4:43149] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43149,1689779417350' 2023-07-19 15:10:19,415 DEBUG [RS:0;jenkins-hbase4:37001] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37001,1689779417218' 2023-07-19 15:10:19,415 DEBUG [RS:0;jenkins-hbase4:37001] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 15:10:19,415 DEBUG [RS:2;jenkins-hbase4:43149] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 15:10:19,416 INFO [RS:1;jenkins-hbase4:44923] regionserver.Replication(203): jenkins-hbase4.apache.org,44923,1689779417285 started 2023-07-19 15:10:19,416 DEBUG [RS:0;jenkins-hbase4:37001] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 15:10:19,416 INFO [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44923,1689779417285, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44923, sessionid=0x1017e2229d90002 2023-07-19 15:10:19,416 DEBUG [RS:2;jenkins-hbase4:43149] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 15:10:19,416 DEBUG [RS:1;jenkins-hbase4:44923] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 15:10:19,417 DEBUG [RS:1;jenkins-hbase4:44923] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:19,417 DEBUG [RS:1;jenkins-hbase4:44923] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44923,1689779417285' 2023-07-19 15:10:19,417 DEBUG [RS:1;jenkins-hbase4:44923] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 15:10:19,417 DEBUG [RS:2;jenkins-hbase4:43149] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 15:10:19,417 DEBUG [RS:0;jenkins-hbase4:37001] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 15:10:19,417 DEBUG [RS:1;jenkins-hbase4:44923] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 15:10:19,417 DEBUG [RS:2;jenkins-hbase4:43149] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 15:10:19,417 DEBUG [RS:0;jenkins-hbase4:37001] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 15:10:19,418 DEBUG [RS:2;jenkins-hbase4:43149] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:19,418 DEBUG [RS:0;jenkins-hbase4:37001] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:19,419 DEBUG [RS:0;jenkins-hbase4:37001] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37001,1689779417218' 2023-07-19 15:10:19,418 DEBUG [RS:2;jenkins-hbase4:43149] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43149,1689779417350' 2023-07-19 15:10:19,419 DEBUG [RS:2;jenkins-hbase4:43149] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:19,419 DEBUG [RS:0;jenkins-hbase4:37001] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:19,420 DEBUG [RS:2;jenkins-hbase4:43149] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:19,420 DEBUG [RS:0;jenkins-hbase4:37001] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:19,422 DEBUG [RS:1;jenkins-hbase4:44923] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 15:10:19,422 DEBUG [RS:1;jenkins-hbase4:44923] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 15:10:19,422 DEBUG [RS:1;jenkins-hbase4:44923] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:19,423 DEBUG [RS:1;jenkins-hbase4:44923] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44923,1689779417285' 2023-07-19 15:10:19,423 DEBUG [RS:1;jenkins-hbase4:44923] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:19,427 DEBUG [RS:2;jenkins-hbase4:43149] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 15:10:19,427 DEBUG [RS:1;jenkins-hbase4:44923] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:19,427 DEBUG [RS:0;jenkins-hbase4:37001] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 15:10:19,427 INFO [RS:2;jenkins-hbase4:43149] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 15:10:19,428 INFO [RS:0;jenkins-hbase4:37001] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 15:10:19,428 INFO [RS:2;jenkins-hbase4:43149] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 15:10:19,428 INFO [RS:0;jenkins-hbase4:37001] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 15:10:19,429 DEBUG [RS:1;jenkins-hbase4:44923] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 15:10:19,429 INFO [RS:1;jenkins-hbase4:44923] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 15:10:19,429 INFO [RS:1;jenkins-hbase4:44923] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 15:10:19,490 DEBUG [jenkins-hbase4:42601] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 15:10:19,506 DEBUG [jenkins-hbase4:42601] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:10:19,517 DEBUG [jenkins-hbase4:42601] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:10:19,517 DEBUG [jenkins-hbase4:42601] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:10:19,517 DEBUG [jenkins-hbase4:42601] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:10:19,517 DEBUG [jenkins-hbase4:42601] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:10:19,520 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44923,1689779417285, state=OPENING 2023-07-19 15:10:19,530 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 15:10:19,533 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:10:19,533 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 15:10:19,538 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:10:19,541 INFO [RS:1;jenkins-hbase4:44923] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44923%2C1689779417285, suffix=, logDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,44923,1689779417285, archiveDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/oldWALs, maxLogs=32 2023-07-19 15:10:19,547 INFO [RS:2;jenkins-hbase4:43149] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43149%2C1689779417350, suffix=, logDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,43149,1689779417350, archiveDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/oldWALs, maxLogs=32 2023-07-19 15:10:19,552 INFO [RS:0;jenkins-hbase4:37001] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37001%2C1689779417218, suffix=, logDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,37001,1689779417218, archiveDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/oldWALs, maxLogs=32 2023-07-19 15:10:19,626 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK] 2023-07-19 15:10:19,629 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK] 2023-07-19 15:10:19,630 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK] 2023-07-19 15:10:19,631 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK] 2023-07-19 15:10:19,631 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK] 2023-07-19 15:10:19,631 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK] 2023-07-19 15:10:19,656 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK] 2023-07-19 15:10:19,658 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK] 2023-07-19 15:10:19,659 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK] 2023-07-19 15:10:19,666 INFO [RS:1;jenkins-hbase4:44923] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,44923,1689779417285/jenkins-hbase4.apache.org%2C44923%2C1689779417285.1689779419543 2023-07-19 15:10:19,667 INFO [RS:0;jenkins-hbase4:37001] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,37001,1689779417218/jenkins-hbase4.apache.org%2C37001%2C1689779417218.1689779419554 2023-07-19 15:10:19,668 DEBUG [RS:1;jenkins-hbase4:44923] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK], DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK], DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK]] 2023-07-19 15:10:19,669 DEBUG [RS:0;jenkins-hbase4:37001] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK], DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK], DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK]] 2023-07-19 15:10:19,671 INFO [RS:2;jenkins-hbase4:43149] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,43149,1689779417350/jenkins-hbase4.apache.org%2C43149%2C1689779417350.1689779419554 2023-07-19 15:10:19,671 DEBUG [RS:2;jenkins-hbase4:43149] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK], DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK], DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK]] 2023-07-19 15:10:19,749 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:19,752 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 15:10:19,755 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 15:10:19,770 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 15:10:19,771 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 15:10:19,777 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44923%2C1689779417285.meta, suffix=.meta, logDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,44923,1689779417285, archiveDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/oldWALs, maxLogs=32 2023-07-19 15:10:19,797 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK] 2023-07-19 15:10:19,802 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK] 2023-07-19 15:10:19,800 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK] 2023-07-19 15:10:19,820 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/WALs/jenkins-hbase4.apache.org,44923,1689779417285/jenkins-hbase4.apache.org%2C44923%2C1689779417285.meta.1689779419778.meta 2023-07-19 15:10:19,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45951,DS-fd93563b-31fc-4e32-873e-d0d666881bf2,DISK], DatanodeInfoWithStorage[127.0.0.1:44573,DS-034518eb-80e5-4617-b082-3cecf78f3f67,DISK], DatanodeInfoWithStorage[127.0.0.1:44055,DS-539606d5-3e4f-4f2b-9b86-ca504d7cbd3d,DISK]] 2023-07-19 15:10:19,821 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 15:10:19,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 15:10:19,824 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:19,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 15:10:19,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 15:10:19,828 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 15:10:19,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 15:10:19,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:19,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 15:10:19,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 15:10:19,855 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 15:10:19,858 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/info 2023-07-19 15:10:19,861 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/info 2023-07-19 15:10:19,862 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 15:10:19,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:19,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 15:10:19,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/rep_barrier 2023-07-19 15:10:19,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/rep_barrier 2023-07-19 15:10:19,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 15:10:19,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:19,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 15:10:19,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/table 2023-07-19 15:10:19,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/table 2023-07-19 15:10:19,872 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 15:10:19,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:19,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740 2023-07-19 15:10:19,882 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740 2023-07-19 15:10:19,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 15:10:19,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 15:10:19,898 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65704058, jitterRate=-0.02093324065208435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 15:10:19,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 15:10:19,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689779419742 2023-07-19 15:10:19,940 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 15:10:19,941 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 15:10:19,942 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44923,1689779417285, state=OPEN 2023-07-19 15:10:19,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 15:10:19,946 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 15:10:19,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 15:10:19,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44923,1689779417285 in 408 msec 2023-07-19 15:10:19,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 15:10:19,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 656 msec 2023-07-19 15:10:19,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2190 sec 2023-07-19 15:10:19,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689779419979, completionTime=-1 2023-07-19 15:10:19,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 15:10:19,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 15:10:20,070 DEBUG [hconnection-0x41920ffa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:20,073 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:20,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 15:10:20,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689779480096 2023-07-19 15:10:20,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689779540096 2023-07-19 15:10:20,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 116 msec 2023-07-19 15:10:20,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42601,1689779415712-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:20,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42601,1689779415712-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:20,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42601,1689779415712-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:20,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42601, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:20,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 15:10:20,165 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 15:10:20,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 15:10:20,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 15:10:20,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 15:10:20,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 15:10:20,198 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 15:10:20,229 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:10:20,233 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35 empty. 2023-07-19 15:10:20,233 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:10:20,234 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 15:10:20,306 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 15:10:20,309 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5972380c30d7cbe06bbdbc0d63cca35, NAME => 'hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:10:20,333 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:20,333 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b5972380c30d7cbe06bbdbc0d63cca35, disabling compactions & flushes 2023-07-19 15:10:20,333 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:10:20,333 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:10:20,333 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. after waiting 0 ms 2023-07-19 15:10:20,333 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:10:20,333 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:10:20,333 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b5972380c30d7cbe06bbdbc0d63cca35: 2023-07-19 15:10:20,339 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 15:10:20,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689779420343"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779420343"}]},"ts":"1689779420343"} 2023-07-19 15:10:20,389 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 15:10:20,391 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 15:10:20,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779420392"}]},"ts":"1689779420392"} 2023-07-19 15:10:20,405 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 15:10:20,410 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:10:20,412 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:10:20,412 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:10:20,412 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:10:20,412 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:10:20,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b5972380c30d7cbe06bbdbc0d63cca35, ASSIGN}] 2023-07-19 15:10:20,419 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b5972380c30d7cbe06bbdbc0d63cca35, ASSIGN 2023-07-19 15:10:20,421 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b5972380c30d7cbe06bbdbc0d63cca35, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43149,1689779417350; forceNewPlan=false, retain=false 2023-07-19 15:10:20,574 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 15:10:20,575 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b5972380c30d7cbe06bbdbc0d63cca35, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:20,575 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689779420574"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779420574"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779420574"}]},"ts":"1689779420574"} 2023-07-19 15:10:20,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b5972380c30d7cbe06bbdbc0d63cca35, server=jenkins-hbase4.apache.org,43149,1689779417350}] 2023-07-19 15:10:20,736 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:20,737 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 15:10:20,740 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 15:10:20,746 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:10:20,746 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5972380c30d7cbe06bbdbc0d63cca35, NAME => 'hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35.', STARTKEY => '', ENDKEY => ''} 2023-07-19 15:10:20,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. service=AccessControlService 2023-07-19 15:10:20,747 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:20,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:10:20,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:20,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:10:20,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:10:20,750 INFO [StoreOpener-b5972380c30d7cbe06bbdbc0d63cca35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:10:20,752 DEBUG [StoreOpener-b5972380c30d7cbe06bbdbc0d63cca35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35/info 2023-07-19 15:10:20,752 DEBUG [StoreOpener-b5972380c30d7cbe06bbdbc0d63cca35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35/info 2023-07-19 15:10:20,753 INFO [StoreOpener-b5972380c30d7cbe06bbdbc0d63cca35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5972380c30d7cbe06bbdbc0d63cca35 columnFamilyName info 2023-07-19 15:10:20,754 INFO [StoreOpener-b5972380c30d7cbe06bbdbc0d63cca35-1] regionserver.HStore(310): Store=b5972380c30d7cbe06bbdbc0d63cca35/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:20,756 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:10:20,757 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:10:20,760 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:10:20,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:10:20,765 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5972380c30d7cbe06bbdbc0d63cca35; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67073897, jitterRate=-5.21048903465271E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:10:20,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5972380c30d7cbe06bbdbc0d63cca35: 2023-07-19 15:10:20,767 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35., pid=6, masterSystemTime=1689779420736 2023-07-19 15:10:20,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:10:20,771 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:10:20,772 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b5972380c30d7cbe06bbdbc0d63cca35, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:20,773 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689779420772"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779420772"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779420772"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779420772"}]},"ts":"1689779420772"} 2023-07-19 15:10:20,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 15:10:20,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b5972380c30d7cbe06bbdbc0d63cca35, server=jenkins-hbase4.apache.org,43149,1689779417350 in 195 msec 2023-07-19 15:10:20,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 15:10:20,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b5972380c30d7cbe06bbdbc0d63cca35, ASSIGN in 364 msec 2023-07-19 15:10:20,784 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 15:10:20,785 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779420784"}]},"ts":"1689779420784"} 2023-07-19 15:10:20,787 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 15:10:20,791 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 15:10:20,794 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 615 msec 2023-07-19 15:10:20,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 15:10:20,795 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 15:10:20,795 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:10:20,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:20,817 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:20,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 15:10:20,864 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 15:10:20,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 47 msec 2023-07-19 15:10:20,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 15:10:20,891 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 15:10:20,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-19 15:10:20,904 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 15:10:20,908 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 15:10:20,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.471sec 2023-07-19 15:10:20,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 15:10:20,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 15:10:20,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 15:10:20,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42601,1689779415712-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 15:10:20,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42601,1689779415712-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 15:10:20,917 DEBUG [Listener at localhost/42995] zookeeper.ReadOnlyZKClient(139): Connect 0x163e546e to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:20,935 DEBUG [Listener at localhost/42995] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@783bbc0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:20,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 15:10:20,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 15:10:20,953 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 15:10:20,956 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 15:10:20,959 DEBUG [hconnection-0x346953fe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:20,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 15:10:20,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 15:10:20,968 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/hbase/acl/71ed98883a9e46dde234461e579e9825 2023-07-19 15:10:20,969 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/hbase/acl/71ed98883a9e46dde234461e579e9825 empty. 2023-07-19 15:10:20,972 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/hbase/acl/71ed98883a9e46dde234461e579e9825 2023-07-19 15:10:20,972 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 15:10:20,982 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:20,985 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:10:20,985 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 15:10:20,985 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/test.cache.data in system properties and HBase conf 2023-07-19 15:10:20,985 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 15:10:20,985 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop.log.dir in system properties and HBase conf 2023-07-19 15:10:20,985 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 15:10:20,985 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 15:10:20,985 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 15:10:20,986 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/nfs.dump.dir in system properties and HBase conf 2023-07-19 15:10:20,987 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir in system properties and HBase conf 2023-07-19 15:10:20,987 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 15:10:20,987 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 15:10:20,987 INFO [Listener at localhost/42995] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 15:10:21,000 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 15:10:21,002 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 71ed98883a9e46dde234461e579e9825, NAME => 'hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:10:21,031 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:21,032 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 71ed98883a9e46dde234461e579e9825, disabling compactions & flushes 2023-07-19 15:10:21,032 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:10:21,032 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:10:21,032 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. after waiting 0 ms 2023-07-19 15:10:21,032 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:10:21,033 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:10:21,033 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 71ed98883a9e46dde234461e579e9825: 2023-07-19 15:10:21,039 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 15:10:21,040 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689779421040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779421040"}]},"ts":"1689779421040"} 2023-07-19 15:10:21,059 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 15:10:21,064 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 15:10:21,066 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779421065"}]},"ts":"1689779421065"} 2023-07-19 15:10:21,070 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 15:10:21,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 15:10:21,077 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:10:21,078 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:10:21,078 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:10:21,078 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:10:21,079 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:10:21,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=71ed98883a9e46dde234461e579e9825, ASSIGN}] 2023-07-19 15:10:21,083 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=71ed98883a9e46dde234461e579e9825, ASSIGN 2023-07-19 15:10:21,085 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=71ed98883a9e46dde234461e579e9825, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37001,1689779417218; forceNewPlan=false, retain=false 2023-07-19 15:10:21,235 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 15:10:21,236 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=71ed98883a9e46dde234461e579e9825, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:21,237 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689779421236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779421236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779421236"}]},"ts":"1689779421236"} 2023-07-19 15:10:21,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 71ed98883a9e46dde234461e579e9825, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:10:21,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 15:10:21,398 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:21,398 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 15:10:21,402 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 15:10:21,410 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:10:21,411 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 71ed98883a9e46dde234461e579e9825, NAME => 'hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825.', STARTKEY => '', ENDKEY => ''} 2023-07-19 15:10:21,411 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. service=AccessControlService 2023-07-19 15:10:21,412 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:21,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 71ed98883a9e46dde234461e579e9825 2023-07-19 15:10:21,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:21,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 71ed98883a9e46dde234461e579e9825 2023-07-19 15:10:21,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 71ed98883a9e46dde234461e579e9825 2023-07-19 15:10:21,414 INFO [StoreOpener-71ed98883a9e46dde234461e579e9825-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 71ed98883a9e46dde234461e579e9825 2023-07-19 15:10:21,418 DEBUG [StoreOpener-71ed98883a9e46dde234461e579e9825-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825/l 2023-07-19 15:10:21,418 DEBUG [StoreOpener-71ed98883a9e46dde234461e579e9825-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825/l 2023-07-19 15:10:21,418 INFO [StoreOpener-71ed98883a9e46dde234461e579e9825-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 71ed98883a9e46dde234461e579e9825 columnFamilyName l 2023-07-19 15:10:21,420 INFO [StoreOpener-71ed98883a9e46dde234461e579e9825-1] regionserver.HStore(310): Store=71ed98883a9e46dde234461e579e9825/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:21,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825 2023-07-19 15:10:21,426 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825 2023-07-19 15:10:21,431 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 71ed98883a9e46dde234461e579e9825 2023-07-19 15:10:21,437 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:10:21,438 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 71ed98883a9e46dde234461e579e9825; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74930028, jitterRate=0.11654442548751831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:10:21,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 71ed98883a9e46dde234461e579e9825: 2023-07-19 15:10:21,440 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825., pid=11, masterSystemTime=1689779421398 2023-07-19 15:10:21,446 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:10:21,446 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:10:21,447 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=71ed98883a9e46dde234461e579e9825, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:21,448 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689779421447"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779421447"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779421447"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779421447"}]},"ts":"1689779421447"} 2023-07-19 15:10:21,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 15:10:21,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 71ed98883a9e46dde234461e579e9825, server=jenkins-hbase4.apache.org,37001,1689779417218 in 214 msec 2023-07-19 15:10:21,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 15:10:21,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=71ed98883a9e46dde234461e579e9825, ASSIGN in 394 msec 2023-07-19 15:10:21,480 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 15:10:21,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779421480"}]},"ts":"1689779421480"} 2023-07-19 15:10:21,483 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 15:10:21,489 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 15:10:21,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 543 msec 2023-07-19 15:10:21,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 15:10:21,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 15:10:21,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 15:10:22,410 WARN [Thread-385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 15:10:22,853 INFO [Thread-385] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 15:10:22,861 INFO [Thread-385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37095_jobhistory____m9k7l/webapp 2023-07-19 15:10:23,057 INFO [Thread-385] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 15:10:23,057 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 15:10:23,058 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 15:10:23,061 INFO [Thread-385] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 15:10:23,202 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:23,582 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:24,086 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 15:10:24,186 INFO [Thread-385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37095 2023-07-19 15:10:25,396 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 15:10:25,400 WARN [Listener at jenkins-hbase4.apache.org/35401] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 15:10:25,691 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 15:10:25,693 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 15:10:25,694 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 15:10:25,719 WARN [Listener at jenkins-hbase4.apache.org/35401] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 15:10:25,720 INFO [Listener at jenkins-hbase4.apache.org/35401] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 15:10:25,734 INFO [Listener at jenkins-hbase4.apache.org/35401] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33273_cluster____5srnw6/webapp 2023-07-19 15:10:25,860 INFO [Listener at jenkins-hbase4.apache.org/35401] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 15:10:25,860 INFO [Listener at jenkins-hbase4.apache.org/35401] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 15:10:25,860 INFO [Listener at jenkins-hbase4.apache.org/35401] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 15:10:25,861 INFO [Listener at jenkins-hbase4.apache.org/35401] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 15:10:25,874 INFO [Listener at jenkins-hbase4.apache.org/35401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:25,905 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:10:25,906 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 15:10:25,907 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:10:25,908 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 15:10:25,908 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 15:10:25,908 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 15:10:25,908 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:10:25,908 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 15:10:25,908 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 15:10:25,909 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 15:10:26,103 INFO [Listener at jenkins-hbase4.apache.org/35401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:26,207 INFO [Listener at jenkins-hbase4.apache.org/35401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:26,216 INFO [Listener at jenkins-hbase4.apache.org/35401] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33273 2023-07-19 15:10:26,900 WARN [Listener at jenkins-hbase4.apache.org/43849] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 15:10:26,930 WARN [Listener at jenkins-hbase4.apache.org/43849] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 15:10:26,931 INFO [Listener at jenkins-hbase4.apache.org/43849] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 15:10:26,943 INFO [Listener at jenkins-hbase4.apache.org/43849] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40663_node____.rjo30r/webapp 2023-07-19 15:10:27,016 INFO [Listener at jenkins-hbase4.apache.org/43849] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 15:10:27,016 INFO [Listener at jenkins-hbase4.apache.org/43849] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 15:10:27,016 INFO [Listener at jenkins-hbase4.apache.org/43849] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 15:10:27,016 INFO [Listener at jenkins-hbase4.apache.org/43849] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 15:10:27,027 INFO [Listener at jenkins-hbase4.apache.org/43849] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:27,067 INFO [Listener at jenkins-hbase4.apache.org/43849] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:27,183 INFO [Listener at jenkins-hbase4.apache.org/43849] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:27,228 INFO [Listener at jenkins-hbase4.apache.org/43849] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40663 2023-07-19 15:10:27,552 WARN [Listener at jenkins-hbase4.apache.org/37699] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 15:10:27,560 WARN [Listener at jenkins-hbase4.apache.org/37699] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 15:10:27,561 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 15:10:27,569 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37211_node____.pxp9zo/webapp 2023-07-19 15:10:27,626 INFO [Listener at jenkins-hbase4.apache.org/37699] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 15:10:27,627 INFO [Listener at jenkins-hbase4.apache.org/37699] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 15:10:27,627 INFO [Listener at jenkins-hbase4.apache.org/37699] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 15:10:27,627 INFO [Listener at jenkins-hbase4.apache.org/37699] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 15:10:27,635 INFO [Listener at jenkins-hbase4.apache.org/37699] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:27,654 INFO [Listener at jenkins-hbase4.apache.org/37699] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:27,739 INFO [Listener at jenkins-hbase4.apache.org/37699] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 15:10:27,752 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37211 2023-07-19 15:10:27,801 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 15:10:27,803 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:10:27,886 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=445, ProcessCount=175, AvailableMemoryMB=5033 2023-07-19 15:10:27,886 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-19 15:10:27,900 DEBUG [Listener at jenkins-hbase4.apache.org/37699] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 15:10:27,905 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 15:10:27,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 15:10:27,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 15:10:27,917 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 15:10:27,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 15:10:27,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 15:10:27,920 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 15:10:27,925 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1 2023-07-19 15:10:27,925 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:27,927 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1 empty. 2023-07-19 15:10:27,927 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103 empty. 2023-07-19 15:10:27,930 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:27,930 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1 2023-07-19 15:10:27,930 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 15:10:27,961 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 15:10:27,963 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9d6003daa8f41d39935b001acb3c6103, NAME => 'testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:10:27,964 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 76328909ec63b25de009c319725f66b1, NAME => 'testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:10:28,001 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:28,001 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 76328909ec63b25de009c319725f66b1, disabling compactions & flushes 2023-07-19 15:10:28,001 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:28,001 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:28,001 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. after waiting 0 ms 2023-07-19 15:10:28,001 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:28,002 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:28,002 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 76328909ec63b25de009c319725f66b1: 2023-07-19 15:10:28,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 15:10:28,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 15:10:28,403 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:28,403 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 9d6003daa8f41d39935b001acb3c6103, disabling compactions & flushes 2023-07-19 15:10:28,403 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:28,403 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:28,403 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. after waiting 0 ms 2023-07-19 15:10:28,403 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:28,403 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:28,403 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 9d6003daa8f41d39935b001acb3c6103: 2023-07-19 15:10:28,408 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 15:10:28,410 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779428409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779428409"}]},"ts":"1689779428409"} 2023-07-19 15:10:28,410 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779428409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779428409"}]},"ts":"1689779428409"} 2023-07-19 15:10:28,463 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 15:10:28,465 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 15:10:28,466 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779428465"}]},"ts":"1689779428465"} 2023-07-19 15:10:28,470 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 15:10:28,476 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:10:28,478 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:10:28,478 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:10:28,478 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:10:28,478 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:10:28,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d6003daa8f41d39935b001acb3c6103, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76328909ec63b25de009c319725f66b1, ASSIGN}] 2023-07-19 15:10:28,481 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d6003daa8f41d39935b001acb3c6103, ASSIGN 2023-07-19 15:10:28,482 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76328909ec63b25de009c319725f66b1, ASSIGN 2023-07-19 15:10:28,483 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76328909ec63b25de009c319725f66b1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37001,1689779417218; forceNewPlan=false, retain=false 2023-07-19 15:10:28,483 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d6003daa8f41d39935b001acb3c6103, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43149,1689779417350; forceNewPlan=false, retain=false 2023-07-19 15:10:28,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 15:10:28,633 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 15:10:28,636 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9d6003daa8f41d39935b001acb3c6103, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:28,636 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=76328909ec63b25de009c319725f66b1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:28,637 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779428636"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779428636"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779428636"}]},"ts":"1689779428636"} 2023-07-19 15:10:28,637 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779428636"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779428636"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779428636"}]},"ts":"1689779428636"} 2023-07-19 15:10:28,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 9d6003daa8f41d39935b001acb3c6103, server=jenkins-hbase4.apache.org,43149,1689779417350}] 2023-07-19 15:10:28,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 76328909ec63b25de009c319725f66b1, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:10:28,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:28,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:28,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d6003daa8f41d39935b001acb3c6103, NAME => 'testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 15:10:28,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76328909ec63b25de009c319725f66b1, NAME => 'testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 15:10:28,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. service=AccessControlService 2023-07-19 15:10:28,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. service=AccessControlService 2023-07-19 15:10:28,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:28,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:28,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:28,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 76328909ec63b25de009c319725f66b1 2023-07-19 15:10:28,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:28,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:28,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:28,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76328909ec63b25de009c319725f66b1 2023-07-19 15:10:28,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:28,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76328909ec63b25de009c319725f66b1 2023-07-19 15:10:28,812 INFO [StoreOpener-9d6003daa8f41d39935b001acb3c6103-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:28,814 INFO [StoreOpener-76328909ec63b25de009c319725f66b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 76328909ec63b25de009c319725f66b1 2023-07-19 15:10:28,816 DEBUG [StoreOpener-9d6003daa8f41d39935b001acb3c6103-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/cf 2023-07-19 15:10:28,816 DEBUG [StoreOpener-9d6003daa8f41d39935b001acb3c6103-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/cf 2023-07-19 15:10:28,817 DEBUG [StoreOpener-76328909ec63b25de009c319725f66b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/cf 2023-07-19 15:10:28,817 DEBUG [StoreOpener-76328909ec63b25de009c319725f66b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/cf 2023-07-19 15:10:28,821 INFO [StoreOpener-76328909ec63b25de009c319725f66b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76328909ec63b25de009c319725f66b1 columnFamilyName cf 2023-07-19 15:10:28,821 INFO [StoreOpener-9d6003daa8f41d39935b001acb3c6103-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d6003daa8f41d39935b001acb3c6103 columnFamilyName cf 2023-07-19 15:10:28,825 INFO [StoreOpener-9d6003daa8f41d39935b001acb3c6103-1] regionserver.HStore(310): Store=9d6003daa8f41d39935b001acb3c6103/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:28,826 INFO [StoreOpener-76328909ec63b25de009c319725f66b1-1] regionserver.HStore(310): Store=76328909ec63b25de009c319725f66b1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:28,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:28,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:28,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1 2023-07-19 15:10:28,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1 2023-07-19 15:10:28,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:28,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76328909ec63b25de009c319725f66b1 2023-07-19 15:10:28,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:10:28,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76328909ec63b25de009c319725f66b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61719602, jitterRate=-0.08030626177787781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:10:28,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76328909ec63b25de009c319725f66b1: 2023-07-19 15:10:28,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1., pid=16, masterSystemTime=1689779428795 2023-07-19 15:10:28,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:28,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:28,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:10:28,858 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=76328909ec63b25de009c319725f66b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:28,859 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779428858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779428858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779428858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779428858"}]},"ts":"1689779428858"} 2023-07-19 15:10:28,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9d6003daa8f41d39935b001acb3c6103; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66850356, jitterRate=-0.00385206937789917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:10:28,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9d6003daa8f41d39935b001acb3c6103: 2023-07-19 15:10:28,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103., pid=15, masterSystemTime=1689779428795 2023-07-19 15:10:28,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:28,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:28,864 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9d6003daa8f41d39935b001acb3c6103, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:28,865 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779428864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779428864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779428864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779428864"}]},"ts":"1689779428864"} 2023-07-19 15:10:28,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-19 15:10:28,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 76328909ec63b25de009c319725f66b1, server=jenkins-hbase4.apache.org,37001,1689779417218 in 222 msec 2023-07-19 15:10:28,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76328909ec63b25de009c319725f66b1, ASSIGN in 389 msec 2023-07-19 15:10:28,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-19 15:10:28,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 9d6003daa8f41d39935b001acb3c6103, server=jenkins-hbase4.apache.org,43149,1689779417350 in 230 msec 2023-07-19 15:10:28,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-19 15:10:28,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d6003daa8f41d39935b001acb3c6103, ASSIGN in 394 msec 2023-07-19 15:10:28,877 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 15:10:28,877 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779428877"}]},"ts":"1689779428877"} 2023-07-19 15:10:28,879 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 15:10:28,883 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 15:10:28,889 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 15:10:28,896 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:28,900 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:28,904 DEBUG [hconnection-0x50764f44-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:28,907 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-19 15:10:28,918 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 15:10:28,949 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:28,949 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:10:28,949 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:28,950 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:28,950 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:28,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 15:10:28,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 15:10:28,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 15:10:28,963 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 15:10:28,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0480 sec 2023-07-19 15:10:29,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 15:10:29,028 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 15:10:29,033 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 15:10:29,034 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:29,037 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:10:29,062 DEBUG [hconnection-0x346953fe-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:29,068 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:29,071 DEBUG [hconnection-0x346953fe-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:29,073 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:29,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 15:10:29,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779429090 (current time:1689779429090). 2023-07-19 15:10:29,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:10:29,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x6b6e76a6 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:29,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b08342f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:29,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:29,103 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:29,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b6e76a6 to 127.0.0.1:52285 2023-07-19 15:10:29,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:10:29,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x472abd63 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:29,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e5c6de4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:29,115 DEBUG [hconnection-0x3d22b7d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:29,116 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:29,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:29,123 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:29,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x472abd63 to 127.0.0.1:52285 2023-07-19 15:10:29,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:10:29,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 15:10:29,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:10:29,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 15:10:29,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 15:10:29,173 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 15:10:29,175 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689780029175 2023-07-19 15:10:29,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 15:10:29,175 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 15:10:29,178 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 15:10:29,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 15:10:29,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-19 15:10:29,181 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 15:10:29,182 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689780029182 2023-07-19 15:10:29,183 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:10:29,183 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:10:29,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,214 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 15:10:29,214 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:29,215 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 15:10:29,215 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 15:10:29,216 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,216 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,220 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:29,220 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:29,220 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:29,220 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:29,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:29,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:29,221 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,221 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,222 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,222 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:10:29,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 15:10:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 15:10:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 15:10:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 15:10:29,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 15:10:29,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 15:10:29,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,226 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 15:10:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 15:10:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 15:10:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 15:10:29,228 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:29,228 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 15:10:29,229 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 15:10:29,229 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 15:10:29,228 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 15:10:29,229 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 15:10:29,229 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 15:10:29,229 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 15:10:29,229 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 15:10:29,233 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,233 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:29,233 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,234 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,234 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,234 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:29,234 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:29,234 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,235 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:29,235 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,238 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:29,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:29,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:29,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 15:10:29,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11980dad[Count = 1] remaining members to acquire global barrier 2023-07-19 15:10:29,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:29,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 15:10:29,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11980dad[Count = 0] remaining members to acquire global barrier 2023-07-19 15:10:29,245 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 15:10:29,245 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,247 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,247 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,247 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,248 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,248 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 15:10:29,248 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 15:10:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,248 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 15:10:29,248 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 15:10:29,248 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:10:29,248 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,248 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:10:29,260 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 15:10:29,260 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:29,260 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 15:10:29,262 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:10:29,263 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:29,263 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:10:29,263 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:10:29,263 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:29,263 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:10:29,264 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. started... 2023-07-19 15:10:29,266 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d6003daa8f41d39935b001acb3c6103: 2023-07-19 15:10:29,268 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,274 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:10:29,278 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:10:29,279 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. started... 2023-07-19 15:10:29,280 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 76328909ec63b25de009c319725f66b1: 2023-07-19 15:10:29,281 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,281 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:10:29,281 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:10:29,284 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:29,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 15:10:29,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:10:29,289 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:10:29,341 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. completed. 2023-07-19 15:10:29,341 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:29,341 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:10:29,342 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. completed. 2023-07-19 15:10:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:10:29,342 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:10:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:10:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 15:10:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 15:10:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:10:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:10:29,345 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,345 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 15:10:29,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:29,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:29,345 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:29,345 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 15:10:29,347 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 15:10:29,347 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:29,347 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:29,347 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 15:10:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43149,1689779417350': 2023-07-19 15:10:29,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 15:10:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:10:29,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 15:10:29,358 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 15:10:29,358 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:10:29,358 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:10:29,358 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,358 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:10:29,361 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,361 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,361 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,361 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:29,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:29,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:29,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,361 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,363 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:29,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,363 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:29,361 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:29,365 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:29,366 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:29,369 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,370 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,370 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,384 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:29,384 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:29,385 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,384 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:29,385 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:29,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:29,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:29,384 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:29,385 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:29,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:29,385 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 15:10:29,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:29,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:10:29,385 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:29,385 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,385 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:29,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:29,387 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:29,385 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:29,387 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:29,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:29,388 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:29,388 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,388 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:29,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:29,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:29,388 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:29,388 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,388 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 15:10:29,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,489 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:29,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 15:10:29,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:10:29,491 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 15:10:29,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 15:10:29,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,541 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:29,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689779429175Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689779429425 (+250 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689779429425Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689779429425Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689779429456 (+31 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689779429486 (+30 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689779429540 (+54 ms) 2023-07-19 15:10:29,543 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 15:10:29,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 365 msec 2023-07-19 15:10:29,791 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:29,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 15:10:29,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:10:29,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43149] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:10:29,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37001] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:10:29,824 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 15:10:29,824 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:29,825 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:10:29,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 15:10:29,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779429844 (current time:1689779429844). 2023-07-19 15:10:29,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:10:29,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x24137105 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:29,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6862ec73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:29,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:29,857 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:29,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24137105 to 127.0.0.1:52285 2023-07-19 15:10:29,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:10:29,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x2200aaef to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:29,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d247cf3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:29,883 DEBUG [hconnection-0x62da0a50-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:29,889 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:29,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:29,896 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:29,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2200aaef to 127.0.0.1:52285 2023-07-19 15:10:29,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:10:29,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 15:10:29,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:10:29,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 15:10:29,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 15:10:29,903 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 15:10:29,904 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689780029904 2023-07-19 15:10:29,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 15:10:29,904 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 15:10:29,906 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:10:29,906 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:10:29,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 15:10:29,908 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 15:10:29,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-19 15:10:29,912 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 15:10:29,913 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689780029913 2023-07-19 15:10:30,006 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:30,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 15:10:30,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:10:30,008 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:10:30,208 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:30,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 15:10:30,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:10:30,210 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 15:10:30,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 15:10:30,337 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 15:10:30,337 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:30,337 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 15:10:30,337 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 15:10:30,338 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,338 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,339 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:30,339 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:30,339 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:30,339 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:30,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:30,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:30,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:30,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:30,340 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:30,340 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,341 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,341 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 15:10:30,341 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 15:10:30,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 15:10:30,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 15:10:30,342 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 15:10:30,342 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:30,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 15:10:30,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 15:10:30,343 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 15:10:30,343 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 15:10:30,343 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 15:10:30,343 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 15:10:30,343 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:30,343 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:30,345 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 15:10:30,346 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 15:10:30,343 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 15:10:30,346 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 15:10:30,346 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 15:10:30,346 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 15:10:30,346 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 15:10:30,348 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,350 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,350 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,350 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,350 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,350 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:30,350 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:30,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 15:10:30,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:30,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 15:10:30,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4839c282[Count = 1] remaining members to acquire global barrier 2023-07-19 15:10:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 15:10:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:30,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 15:10:30,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4839c282[Count = 0] remaining members to acquire global barrier 2023-07-19 15:10:30,356 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 15:10:30,356 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,362 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,362 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,362 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 15:10:30,362 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 15:10:30,362 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,362 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,362 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:10:30,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,363 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:30,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,363 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. started... 2023-07-19 15:10:30,363 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 15:10:30,363 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 15:10:30,363 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:10:30,363 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,363 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:10:30,363 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9d6003daa8f41d39935b001acb3c6103 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 15:10:30,363 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:10:30,363 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:10:30,363 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:10:30,363 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:30,363 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. started... 2023-07-19 15:10:30,363 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 76328909ec63b25de009c319725f66b1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 15:10:30,366 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 15:10:30,366 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:30,366 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 15:10:30,511 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:30,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 15:10:30,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:10:30,513 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 15:10:30,517 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307191856a24bf0344a8abb7270cbf240fc64 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191856a24bf0344a8abb7270cbf240fc64 2023-07-19 15:10:30,517 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071900f14475f62a4eddb76f5bb153168776 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071900f14475f62a4eddb76f5bb153168776 2023-07-19 15:10:30,576 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/.tmp/cf/a7c7325283fa4d68be260c95dae3c308 2023-07-19 15:10:30,577 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/.tmp/cf/3f60c6e208f44a858c95deff10712afb 2023-07-19 15:10:30,589 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/.tmp/cf/a7c7325283fa4d68be260c95dae3c308 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/cf/a7c7325283fa4d68be260c95dae3c308 2023-07-19 15:10:30,589 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/.tmp/cf/3f60c6e208f44a858c95deff10712afb as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/cf/3f60c6e208f44a858c95deff10712afb 2023-07-19 15:10:30,597 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/cf/3f60c6e208f44a858c95deff10712afb, entries=47, sequenceid=6, filesize=12.8 K 2023-07-19 15:10:30,599 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 76328909ec63b25de009c319725f66b1 in 236ms, sequenceid=6, compaction requested=false 2023-07-19 15:10:30,599 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 15:10:30,600 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 76328909ec63b25de009c319725f66b1: 2023-07-19 15:10:30,601 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 15:10:30,601 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:10:30,602 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/cf/3f60c6e208f44a858c95deff10712afb] hfiles 2023-07-19 15:10:30,602 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/cf/3f60c6e208f44a858c95deff10712afb for snapshot=snaptb0-testExportWithTargetName 2023-07-19 15:10:30,604 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/cf/a7c7325283fa4d68be260c95dae3c308, entries=3, sequenceid=6, filesize=5.4 K 2023-07-19 15:10:30,608 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 9d6003daa8f41d39935b001acb3c6103 in 245ms, sequenceid=6, compaction requested=false 2023-07-19 15:10:30,610 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d6003daa8f41d39935b001acb3c6103: 2023-07-19 15:10:30,610 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 15:10:30,610 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:10:30,610 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/cf/a7c7325283fa4d68be260c95dae3c308] hfiles 2023-07-19 15:10:30,610 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/cf/a7c7325283fa4d68be260c95dae3c308 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 15:10:30,640 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. completed. 2023-07-19 15:10:30,640 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:30,640 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:10:30,640 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:10:30,640 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,640 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 15:10:30,640 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:10:30,642 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. completed. 2023-07-19 15:10:30,643 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:30,643 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:10:30,643 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:10:30,643 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,643 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 15:10:30,643 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:10:30,644 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,644 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 15:10:30,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,644 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:30,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:30,644 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 15:10:30,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:30,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:30,649 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:30,649 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 15:10:30,649 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:30,649 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 15:10:30,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 15:10:30,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:30,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 15:10:30,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43149,1689779417350': 2023-07-19 15:10:30,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 15:10:30,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:30,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:30,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:30,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:30,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 15:10:30,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:30,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 15:10:30,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:10:30,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 15:10:30,658 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 15:10:30,658 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:10:30,658 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:10:30,658 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 15:10:30,658 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:10:30,660 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,660 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,660 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:30,660 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,660 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,660 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:30,660 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:30,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:30,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,661 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:30,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:30,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:30,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,662 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 15:10:30,663 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:30,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 15:10:30,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:30,665 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 15:10:30,666 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,667 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,677 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,677 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,677 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:30,677 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:30,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:30,677 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:30,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:30,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 15:10:30,678 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:30,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 15:10:30,678 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:30,677 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 15:10:30,678 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:10:30,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:30,678 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:30,678 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:30,678 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:30,678 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:30,679 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,679 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:30,679 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:30,679 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,679 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:30,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191856a24bf0344a8abb7270cbf240fc64, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071900f14475f62a4eddb76f5bb153168776] mob files 2023-07-19 15:10:30,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191856a24bf0344a8abb7270cbf240fc64 2023-07-19 15:10:30,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071900f14475f62a4eddb76f5bb153168776 2023-07-19 15:10:30,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:30,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:30,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:30,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:30,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 15:10:30,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 15:10:30,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,794 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 15:10:30,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689779429904Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689779430703 (+799 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689779430703Loading Region manifests for snaptb0-testExportWithTargetName at 1689779430704 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689779430710 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689779430732 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689779430794 (+62 ms) 2023-07-19 15:10:30,796 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 15:10:30,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 891 msec 2023-07-19 15:10:31,013 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:31,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 15:10:31,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:10:31,017 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017 2023-07-19 15:10:31,018 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44363, tgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017, rawTgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017, srcFsUri=hdfs://localhost:44363, srcDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:10:31,060 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:10:31,060 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_249353319_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 15:10:31,060 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983, snapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 15:10:31,079 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 15:10:31,566 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:31,567 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:31,567 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:31,568 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:32,650 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-7010595982834564578.jar 2023-07-19 15:10:32,651 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:32,651 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:32,721 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-6748753844943633946.jar 2023-07-19 15:10:32,722 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:32,722 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:32,723 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:32,723 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:32,724 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:32,724 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:32,725 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 15:10:32,725 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 15:10:32,725 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 15:10:32,726 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 15:10:32,726 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 15:10:32,727 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 15:10:32,727 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 15:10:32,728 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 15:10:32,728 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 15:10:32,729 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 15:10:32,732 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:10:32,733 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:10:32,733 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:10:32,733 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:10:32,734 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:10:32,734 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:10:32,735 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:10:34,032 WARN [Listener at jenkins-hbase4.apache.org/37699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 15:10:34,040 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 15:10:34,051 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 15:10:34,329 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 15:10:34,662 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:10:34,663 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:10:34,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0001_000001 (auth:SIMPLE) 2023-07-19 15:10:39,967 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0001_000001 (auth:SIMPLE) 2023-07-19 15:10:42,250 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0001_000001 (auth:SIMPLE) 2023-07-19 15:10:45,992 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0001_000001 (auth:SIMPLE) 2023-07-19 15:10:47,131 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 15:10:47,133 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 15:10:47,145 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 15:10:47,145 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 15:10:47,147 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 15:10:47,147 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 15:10:47,148 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 15:10:47,148 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 15:10:47,148 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017/.hbase-snapshot/testExportWithTargetName 2023-07-19 15:10:47,149 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 15:10:47,149 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779431017/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 15:10:47,159 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 15:10:47,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 15:10:47,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 15:10:47,179 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779447179"}]},"ts":"1689779447179"} 2023-07-19 15:10:47,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 15:10:47,181 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 15:10:47,184 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 15:10:47,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d6003daa8f41d39935b001acb3c6103, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76328909ec63b25de009c319725f66b1, UNASSIGN}] 2023-07-19 15:10:47,189 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d6003daa8f41d39935b001acb3c6103, UNASSIGN 2023-07-19 15:10:47,189 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76328909ec63b25de009c319725f66b1, UNASSIGN 2023-07-19 15:10:47,190 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=76328909ec63b25de009c319725f66b1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:47,190 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9d6003daa8f41d39935b001acb3c6103, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:47,190 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779447190"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779447190"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779447190"}]},"ts":"1689779447190"} 2023-07-19 15:10:47,191 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779447190"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779447190"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779447190"}]},"ts":"1689779447190"} 2023-07-19 15:10:47,193 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 76328909ec63b25de009c319725f66b1, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:10:47,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 9d6003daa8f41d39935b001acb3c6103, server=jenkins-hbase4.apache.org,43149,1689779417350}] 2023-07-19 15:10:47,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 15:10:47,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 76328909ec63b25de009c319725f66b1 2023-07-19 15:10:47,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:47,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76328909ec63b25de009c319725f66b1, disabling compactions & flushes 2023-07-19 15:10:47,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9d6003daa8f41d39935b001acb3c6103, disabling compactions & flushes 2023-07-19 15:10:47,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:47,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:47,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:47,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:47,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. after waiting 0 ms 2023-07-19 15:10:47,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. after waiting 0 ms 2023-07-19 15:10:47,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:47,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:47,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:10:47,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:10:47,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:10:47,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:10:47,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103. 2023-07-19 15:10:47,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1. 2023-07-19 15:10:47,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9d6003daa8f41d39935b001acb3c6103: 2023-07-19 15:10:47,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76328909ec63b25de009c319725f66b1: 2023-07-19 15:10:47,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 76328909ec63b25de009c319725f66b1 2023-07-19 15:10:47,378 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=76328909ec63b25de009c319725f66b1, regionState=CLOSED 2023-07-19 15:10:47,379 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779447378"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779447378"}]},"ts":"1689779447378"} 2023-07-19 15:10:47,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:47,380 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9d6003daa8f41d39935b001acb3c6103, regionState=CLOSED 2023-07-19 15:10:47,380 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689779447380"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779447380"}]},"ts":"1689779447380"} 2023-07-19 15:10:47,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-19 15:10:47,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 76328909ec63b25de009c319725f66b1, server=jenkins-hbase4.apache.org,37001,1689779417218 in 189 msec 2023-07-19 15:10:47,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-19 15:10:47,386 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 9d6003daa8f41d39935b001acb3c6103, server=jenkins-hbase4.apache.org,43149,1689779417350 in 190 msec 2023-07-19 15:10:47,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76328909ec63b25de009c319725f66b1, UNASSIGN in 198 msec 2023-07-19 15:10:47,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-19 15:10:47,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d6003daa8f41d39935b001acb3c6103, UNASSIGN in 199 msec 2023-07-19 15:10:47,391 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779447391"}]},"ts":"1689779447391"} 2023-07-19 15:10:47,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 15:10:47,394 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 15:10:47,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 227 msec 2023-07-19 15:10:47,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 15:10:47,483 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 15:10:47,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 15:10:47,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 15:10:47,497 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 15:10:47,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 15:10:47,499 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 15:10:47,502 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 15:10:47,505 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 15:10:47,505 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 15:10:47,505 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 15:10:47,505 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 15:10:47,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:47,507 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1 2023-07-19 15:10:47,507 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:47,508 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:47,507 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:47,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 15:10:47,508 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 15:10:47,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 15:10:47,508 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 15:10:47,508 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:47,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 15:10:47,508 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 15:10:47,509 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 15:10:47,509 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 15:10:47,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 15:10:47,511 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/recovered.edits] 2023-07-19 15:10:47,511 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/recovered.edits] 2023-07-19 15:10:47,519 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/cf/3f60c6e208f44a858c95deff10712afb to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/cf/3f60c6e208f44a858c95deff10712afb 2023-07-19 15:10:47,520 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/cf/a7c7325283fa4d68be260c95dae3c308 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/cf/a7c7325283fa4d68be260c95dae3c308 2023-07-19 15:10:47,524 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1/recovered.edits/9.seqid 2023-07-19 15:10:47,524 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103/recovered.edits/9.seqid 2023-07-19 15:10:47,525 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/76328909ec63b25de009c319725f66b1 2023-07-19 15:10:47,525 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportWithTargetName/9d6003daa8f41d39935b001acb3c6103 2023-07-19 15:10:47,525 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 15:10:47,525 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 15:10:47,526 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-19 15:10:47,530 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191856a24bf0344a8abb7270cbf240fc64 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191856a24bf0344a8abb7270cbf240fc64 2023-07-19 15:10:47,532 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071900f14475f62a4eddb76f5bb153168776 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071900f14475f62a4eddb76f5bb153168776 2023-07-19 15:10:47,532 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 15:10:47,535 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 15:10:47,558 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 15:10:47,561 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 15:10:47,562 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 15:10:47,562 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 15:10:47,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779447562"}]},"ts":"9223372036854775807"} 2023-07-19 15:10:47,563 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779447562"}]},"ts":"9223372036854775807"} 2023-07-19 15:10:47,565 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 15:10:47,565 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9d6003daa8f41d39935b001acb3c6103, NAME => 'testtb-testExportWithTargetName,,1689779427911.9d6003daa8f41d39935b001acb3c6103.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 76328909ec63b25de009c319725f66b1, NAME => 'testtb-testExportWithTargetName,1,1689779427911.76328909ec63b25de009c319725f66b1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 15:10:47,565 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 15:10:47,566 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689779447565"}]},"ts":"9223372036854775807"} 2023-07-19 15:10:47,567 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 15:10:47,570 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 15:10:47,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-07-19 15:10:47,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 15:10:47,614 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 15:10:47,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 15:10:47,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 15:10:47,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 15:10:47,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 15:10:47,671 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 705) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:36363 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:33244 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:37466 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1318 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:43241 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:43849 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:60222 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1230280047_1 at /127.0.0.1:60200 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1230280047_1 at /127.0.0.1:33218 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=449 (was 445) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3291 (was 5033) 2023-07-19 15:10:47,671 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-19 15:10:47,691 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=449, ProcessCount=181, AvailableMemoryMB=3289 2023-07-19 15:10:47,691 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-19 15:10:47,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 15:10:47,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 15:10:47,698 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 15:10:47,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 15:10:47,700 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 15:10:47,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 15:10:47,703 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:10:47,703 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:10:47,703 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a empty. 2023-07-19 15:10:47,703 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec empty. 2023-07-19 15:10:47,704 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:10:47,704 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:10:47,704 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 15:10:47,716 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 15:10:47,717 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b120837a61f01c43a93a75b95a76aa6a, NAME => 'testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:10:47,718 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ecb2f37e12b8ccab9d1348f4405d83ec, NAME => 'testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:10:47,739 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:47,740 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ecb2f37e12b8ccab9d1348f4405d83ec, disabling compactions & flushes 2023-07-19 15:10:47,740 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:47,740 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:47,740 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. after waiting 0 ms 2023-07-19 15:10:47,740 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:47,740 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:47,740 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ecb2f37e12b8ccab9d1348f4405d83ec: 2023-07-19 15:10:47,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:47,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b120837a61f01c43a93a75b95a76aa6a, disabling compactions & flushes 2023-07-19 15:10:47,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:47,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:47,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. after waiting 0 ms 2023-07-19 15:10:47,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:47,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:47,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b120837a61f01c43a93a75b95a76aa6a: 2023-07-19 15:10:47,745 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 15:10:47,747 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779447746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779447746"}]},"ts":"1689779447746"} 2023-07-19 15:10:47,747 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779447746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779447746"}]},"ts":"1689779447746"} 2023-07-19 15:10:47,749 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 15:10:47,751 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 15:10:47,751 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779447751"}]},"ts":"1689779447751"} 2023-07-19 15:10:47,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 15:10:47,756 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:10:47,757 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:10:47,757 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:10:47,757 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:10:47,757 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:10:47,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b120837a61f01c43a93a75b95a76aa6a, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ecb2f37e12b8ccab9d1348f4405d83ec, ASSIGN}] 2023-07-19 15:10:47,760 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b120837a61f01c43a93a75b95a76aa6a, ASSIGN 2023-07-19 15:10:47,761 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ecb2f37e12b8ccab9d1348f4405d83ec, ASSIGN 2023-07-19 15:10:47,762 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b120837a61f01c43a93a75b95a76aa6a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37001,1689779417218; forceNewPlan=false, retain=false 2023-07-19 15:10:47,762 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ecb2f37e12b8ccab9d1348f4405d83ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44923,1689779417285; forceNewPlan=false, retain=false 2023-07-19 15:10:47,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 15:10:47,912 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 15:10:47,914 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ecb2f37e12b8ccab9d1348f4405d83ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:47,914 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b120837a61f01c43a93a75b95a76aa6a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:47,915 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779447914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779447914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779447914"}]},"ts":"1689779447914"} 2023-07-19 15:10:47,915 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779447914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779447914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779447914"}]},"ts":"1689779447914"} 2023-07-19 15:10:47,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure ecb2f37e12b8ccab9d1348f4405d83ec, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:10:47,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure b120837a61f01c43a93a75b95a76aa6a, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:10:48,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 15:10:48,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:48,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b120837a61f01c43a93a75b95a76aa6a, NAME => 'testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 15:10:48,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. service=AccessControlService 2023-07-19 15:10:48,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:48,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:10:48,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:48,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:10:48,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:10:48,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:48,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ecb2f37e12b8ccab9d1348f4405d83ec, NAME => 'testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 15:10:48,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. service=AccessControlService 2023-07-19 15:10:48,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:10:48,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:10:48,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:10:48,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:10:48,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:10:48,082 INFO [StoreOpener-b120837a61f01c43a93a75b95a76aa6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:10:48,084 INFO [StoreOpener-ecb2f37e12b8ccab9d1348f4405d83ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:10:48,084 DEBUG [StoreOpener-b120837a61f01c43a93a75b95a76aa6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/cf 2023-07-19 15:10:48,084 DEBUG [StoreOpener-b120837a61f01c43a93a75b95a76aa6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/cf 2023-07-19 15:10:48,085 DEBUG [StoreOpener-ecb2f37e12b8ccab9d1348f4405d83ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/cf 2023-07-19 15:10:48,085 INFO [StoreOpener-b120837a61f01c43a93a75b95a76aa6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b120837a61f01c43a93a75b95a76aa6a columnFamilyName cf 2023-07-19 15:10:48,085 DEBUG [StoreOpener-ecb2f37e12b8ccab9d1348f4405d83ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/cf 2023-07-19 15:10:48,086 INFO [StoreOpener-ecb2f37e12b8ccab9d1348f4405d83ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecb2f37e12b8ccab9d1348f4405d83ec columnFamilyName cf 2023-07-19 15:10:48,088 INFO [StoreOpener-b120837a61f01c43a93a75b95a76aa6a-1] regionserver.HStore(310): Store=b120837a61f01c43a93a75b95a76aa6a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:48,089 INFO [StoreOpener-ecb2f37e12b8ccab9d1348f4405d83ec-1] regionserver.HStore(310): Store=ecb2f37e12b8ccab9d1348f4405d83ec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:10:48,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:10:48,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:10:48,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:10:48,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:10:48,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:10:48,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:10:48,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:10:48,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:10:48,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b120837a61f01c43a93a75b95a76aa6a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67119719, jitterRate=1.617521047592163E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:10:48,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ecb2f37e12b8ccab9d1348f4405d83ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70920334, jitterRate=0.056795328855514526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:10:48,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b120837a61f01c43a93a75b95a76aa6a: 2023-07-19 15:10:48,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ecb2f37e12b8ccab9d1348f4405d83ec: 2023-07-19 15:10:48,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a., pid=31, masterSystemTime=1689779448070 2023-07-19 15:10:48,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec., pid=30, masterSystemTime=1689779448070 2023-07-19 15:10:48,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:48,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:48,104 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b120837a61f01c43a93a75b95a76aa6a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:48,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:48,104 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779448104"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779448104"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779448104"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779448104"}]},"ts":"1689779448104"} 2023-07-19 15:10:48,105 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ecb2f37e12b8ccab9d1348f4405d83ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,105 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779448105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779448105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779448105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779448105"}]},"ts":"1689779448105"} 2023-07-19 15:10:48,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-19 15:10:48,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure b120837a61f01c43a93a75b95a76aa6a, server=jenkins-hbase4.apache.org,37001,1689779417218 in 189 msec 2023-07-19 15:10:48,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-19 15:10:48,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure ecb2f37e12b8ccab9d1348f4405d83ec, server=jenkins-hbase4.apache.org,44923,1689779417285 in 194 msec 2023-07-19 15:10:48,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b120837a61f01c43a93a75b95a76aa6a, ASSIGN in 358 msec 2023-07-19 15:10:48,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-19 15:10:48,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ecb2f37e12b8ccab9d1348f4405d83ec, ASSIGN in 362 msec 2023-07-19 15:10:48,127 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 15:10:48,127 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779448127"}]},"ts":"1689779448127"} 2023-07-19 15:10:48,129 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 15:10:48,133 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 15:10:48,134 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 15:10:48,136 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 15:10:48,137 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:48,137 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:48,138 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:48,138 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:10:48,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 15:10:48,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 15:10:48,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 15:10:48,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 15:10:48,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 446 msec 2023-07-19 15:10:48,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 15:10:48,305 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 15:10:48,312 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 15:10:48,312 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:48,315 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:10:48,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:10:48,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779448339 (current time:1689779448339). 2023-07-19 15:10:48,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:10:48,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x088f98f1 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:48,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f9bac95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:48,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:48,354 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:48,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x088f98f1 to 127.0.0.1:52285 2023-07-19 15:10:48,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:10:48,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x2873b892 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:48,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ccff57d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:48,366 DEBUG [hconnection-0xe620575-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:48,370 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:48,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:48,383 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:48,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2873b892 to 127.0.0.1:52285 2023-07-19 15:10:48,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:10:48,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 15:10:48,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:10:48,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:10:48,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:10:48,394 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:10:48,396 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689780048396 2023-07-19 15:10:48,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:10:48,396 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 15:10:48,398 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:10:48,398 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:10:48,400 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:10:48,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 15:10:48,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-07-19 15:10:48,404 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 15:10:48,405 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689780048405 2023-07-19 15:10:48,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,440 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 15:10:48,441 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:48,442 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 15:10:48,442 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 15:10:48,443 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,443 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,444 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,444 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,444 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,444 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,445 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,445 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,446 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,446 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,446 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 15:10:48,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 15:10:48,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,447 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 15:10:48,447 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 15:10:48,447 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:48,447 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 15:10:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 15:10:48,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 15:10:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 15:10:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 15:10:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 15:10:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:48,452 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 15:10:48,454 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 15:10:48,456 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 15:10:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 15:10:48,457 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,457 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,458 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,458 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,462 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,463 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:48,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:48,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 15:10:48,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a02137[Count = 1] remaining members to acquire global barrier 2023-07-19 15:10:48,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 15:10:48,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a02137[Count = 0] remaining members to acquire global barrier 2023-07-19 15:10:48,471 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 15:10:48,471 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,473 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,473 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,473 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,473 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:10:48,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:10:48,474 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:10:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:10:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 15:10:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:10:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:10:48,474 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:48,474 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. started... 2023-07-19 15:10:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:10:48,474 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:10:48,474 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:48,474 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,476 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:10:48,474 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. started... 2023-07-19 15:10:48,476 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ecb2f37e12b8ccab9d1348f4405d83ec: 2023-07-19 15:10:48,476 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b120837a61f01c43a93a75b95a76aa6a: 2023-07-19 15:10:48,476 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,476 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:10:48,476 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,477 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:10:48,477 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:10:48,477 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:10:48,478 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 15:10:48,478 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:48,478 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 15:10:48,498 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:48,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 15:10:48,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:10:48,502 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:10:48,523 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. completed. 2023-07-19 15:10:48,523 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:48,525 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:10:48,525 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:10:48,525 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,525 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 15:10:48,525 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:10:48,527 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 15:10:48,527 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:48,527 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 15:10:48,537 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,539 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. completed. 2023-07-19 15:10:48,539 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:48,539 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:10:48,539 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:10:48,539 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,539 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 15:10:48,539 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:10:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,541 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 15:10:48,541 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,541 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:48,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,541 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 15:10:48,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:10:48,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 15:10:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:10:48,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 15:10:48,554 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 15:10:48,554 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:10:48,554 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:10:48,554 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,554 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:10:48,556 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,557 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,557 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,557 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,559 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,559 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,560 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,562 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,569 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,570 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,575 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,575 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,575 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,575 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,575 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,575 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,575 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 15:10:48,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,576 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:48,575 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,576 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,576 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,576 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,576 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,576 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,576 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,576 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,576 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:10:48,577 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 15:10:48,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 15:10:48,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,691 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 15:10:48,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689779448396Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689779448625 (+229 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689779448625Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689779448626 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689779448631 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689779448653 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689779448691 (+38 ms) 2023-07-19 15:10:48,694 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 15:10:48,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 297 msec 2023-07-19 15:10:48,702 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:48,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 15:10:48,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:10:48,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37001] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:10:48,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44923] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:10:48,714 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 15:10:48,714 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:48,715 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:10:48,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:10:48,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779448727 (current time:1689779448727). 2023-07-19 15:10:48,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:10:48,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x5ca6ff52 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:48,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ffc5e7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:48,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:48,738 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:48,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ca6ff52 to 127.0.0.1:52285 2023-07-19 15:10:48,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:10:48,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x37096ca2 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:10:48,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@117cdb04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:10:48,749 DEBUG [hconnection-0x933a164-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:48,750 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:48,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:10:48,756 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:10:48,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37096ca2 to 127.0.0.1:52285 2023-07-19 15:10:48,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:10:48,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 15:10:48,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:10:48,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:10:48,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:10:48,762 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:10:48,763 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689780048763 2023-07-19 15:10:48,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:10:48,763 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 15:10:48,764 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:10:48,764 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:10:48,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 15:10:48,766 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:10:48,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-19 15:10:48,769 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 15:10:48,769 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689780048769 2023-07-19 15:10:48,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 15:10:48,780 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 15:10:48,780 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:48,781 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 15:10:48,781 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 15:10:48,782 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,782 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,783 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,783 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,783 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,783 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,783 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,784 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,784 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,784 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:10:48,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 15:10:48,785 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 15:10:48,785 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 15:10:48,785 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 15:10:48,786 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 15:10:48,786 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 15:10:48,785 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 15:10:48,786 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:48,786 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:10:48,787 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 15:10:48,788 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 15:10:48,786 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 15:10:48,788 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 15:10:48,788 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 15:10:48,788 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 15:10:48,788 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 15:10:48,788 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 15:10:48,789 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,789 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,792 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,792 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,792 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,792 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:48,792 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,792 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,792 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:48,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,792 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,792 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 15:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 15:10:48,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5084a1cb[Count = 1] remaining members to acquire global barrier 2023-07-19 15:10:48,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 15:10:48,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 15:10:48,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5084a1cb[Count = 0] remaining members to acquire global barrier 2023-07-19 15:10:48,796 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 15:10:48,797 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,797 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,797 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,797 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,798 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:10:48,798 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,798 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:10:48,798 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:10:48,798 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:48,798 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:10:48,798 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. started... 2023-07-19 15:10:48,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,798 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:48,798 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:10:48,798 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b120837a61f01c43a93a75b95a76aa6a 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 15:10:48,798 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:10:48,799 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:10:48,798 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,799 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:10:48,798 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 15:10:48,799 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:10:48,798 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. started... 2023-07-19 15:10:48,799 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ecb2f37e12b8ccab9d1348f4405d83ec 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 15:10:48,800 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 15:10:48,800 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:48,800 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 15:10:48,836 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071955835727c83842609aa6557540c03849 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071955835727c83842609aa6557540c03849 2023-07-19 15:10:48,838 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307198ff2bc790e304b079127b5038e2c8202 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307198ff2bc790e304b079127b5038e2c8202 2023-07-19 15:10:48,859 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/.tmp/cf/979acaedd53442a9b99cd37aa15a8993 2023-07-19 15:10:48,863 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/.tmp/cf/dceb0c2beed9454ab21d68604f42a61e 2023-07-19 15:10:48,867 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:48,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 15:10:48,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:10:48,869 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:10:48,871 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/.tmp/cf/979acaedd53442a9b99cd37aa15a8993 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/cf/979acaedd53442a9b99cd37aa15a8993 2023-07-19 15:10:48,874 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/.tmp/cf/dceb0c2beed9454ab21d68604f42a61e as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/cf/dceb0c2beed9454ab21d68604f42a61e 2023-07-19 15:10:48,877 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/cf/979acaedd53442a9b99cd37aa15a8993, entries=4, sequenceid=6, filesize=5.6 K 2023-07-19 15:10:48,878 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b120837a61f01c43a93a75b95a76aa6a in 80ms, sequenceid=6, compaction requested=false 2023-07-19 15:10:48,879 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 15:10:48,879 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b120837a61f01c43a93a75b95a76aa6a: 2023-07-19 15:10:48,879 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 15:10:48,880 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:10:48,880 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/cf/979acaedd53442a9b99cd37aa15a8993] hfiles 2023-07-19 15:10:48,880 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/cf/979acaedd53442a9b99cd37aa15a8993 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 15:10:48,880 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/cf/dceb0c2beed9454ab21d68604f42a61e, entries=46, sequenceid=6, filesize=12.7 K 2023-07-19 15:10:48,881 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for ecb2f37e12b8ccab9d1348f4405d83ec in 82ms, sequenceid=6, compaction requested=false 2023-07-19 15:10:48,882 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ecb2f37e12b8ccab9d1348f4405d83ec: 2023-07-19 15:10:48,882 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 15:10:48,882 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:10:48,882 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/cf/dceb0c2beed9454ab21d68604f42a61e] hfiles 2023-07-19 15:10:48,883 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/cf/dceb0c2beed9454ab21d68604f42a61e for snapshot=snaptb0-testExportFileSystemState 2023-07-19 15:10:48,891 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. completed. 2023-07-19 15:10:48,891 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:10:48,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:10:48,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:10:48,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 15:10:48,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:10:48,897 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,897 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 15:10:48,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,897 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:48,897 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 15:10:48,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 15:10:48,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 15:10:48,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:10:48,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 15:10:48,907 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. completed. 2023-07-19 15:10:48,907 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:10:48,907 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:10:48,907 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:10:48,907 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,907 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 15:10:48,907 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:10:48,909 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 15:10:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 15:10:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 15:10:48,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 15:10:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:10:48,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 15:10:48,933 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 15:10:48,933 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:10:48,933 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:10:48,933 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 15:10:48,933 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:10:48,935 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,936 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,936 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,935 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,936 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,936 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,936 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,936 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:10:48,937 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:10:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,937 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 15:10:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:10:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 15:10:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,940 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,940 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,941 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:10:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 15:10:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,945 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,946 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:10:48,946 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 15:10:48,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:10:48,946 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:10:48,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,947 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:10:48,949 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:10:48,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:10:48,946 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:10:48,949 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:10:48,949 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:10:48,949 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,949 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 15:10:48,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:10:48,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:10:48,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307198ff2bc790e304b079127b5038e2c8202, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071955835727c83842609aa6557540c03849] mob files 2023-07-19 15:10:48,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307198ff2bc790e304b079127b5038e2c8202 2023-07-19 15:10:48,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071955835727c83842609aa6557540c03849 2023-07-19 15:10:48,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 15:10:48,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 15:10:49,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 15:10:49,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 15:10:49,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 15:10:49,026 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 15:10:49,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689779448763Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689779448965 (+202 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689779448965Loading Region manifests for snaptb0-testExportFileSystemState at 1689779448965Writing data manifest for snaptb0-testExportFileSystemState at 1689779448976 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689779448995 (+19 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689779449026 (+31 ms) 2023-07-19 15:10:49,029 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 15:10:49,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 265 msec 2023-07-19 15:10:49,069 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:10:49,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 15:10:49,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:10:49,070 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070 2023-07-19 15:10:49,071 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44363, tgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070, rawTgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070, srcFsUri=hdfs://localhost:44363, srcDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:10:49,096 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:10:49,097 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1867204506_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 15:10:49,097 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983, snapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 15:10:49,116 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 15:10:49,157 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:49,158 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:49,158 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:49,159 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:50,087 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-1968218301353106231.jar 2023-07-19 15:10:50,088 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:50,088 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:50,174 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-5847783951780012908.jar 2023-07-19 15:10:50,175 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:50,176 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:50,176 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:50,177 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:50,177 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:50,178 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 15:10:50,178 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 15:10:50,179 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 15:10:50,179 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 15:10:50,180 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 15:10:50,180 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 15:10:50,181 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 15:10:50,181 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 15:10:50,182 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 15:10:50,183 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 15:10:50,183 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 15:10:50,184 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:10:50,185 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:10:50,186 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:10:50,186 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:10:50,187 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:10:50,188 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:10:50,188 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:10:51,127 WARN [Listener at jenkins-hbase4.apache.org/37699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 15:10:51,130 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 15:10:51,133 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 15:10:52,100 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:10:52,100 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:10:52,106 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0001_000001 (auth:SIMPLE) 2023-07-19 15:10:52,980 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 15:10:52,980 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0002_000001 (auth:SIMPLE) 2023-07-19 15:10:57,650 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0002_000001 (auth:SIMPLE) 2023-07-19 15:10:59,879 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0002_000001 (auth:SIMPLE) 2023-07-19 15:11:04,383 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 15:11:04,387 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 15:11:04,396 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 15:11:04,396 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 15:11:04,397 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 15:11:04,397 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 15:11:04,397 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 15:11:04,397 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 15:11:04,397 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 15:11:04,398 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 15:11:04,398 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779449070/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 15:11:04,408 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 15:11:04,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 15:11:04,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 15:11:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 15:11:04,415 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779464415"}]},"ts":"1689779464415"} 2023-07-19 15:11:04,417 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 15:11:04,419 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 15:11:04,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b120837a61f01c43a93a75b95a76aa6a, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ecb2f37e12b8ccab9d1348f4405d83ec, UNASSIGN}] 2023-07-19 15:11:04,422 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b120837a61f01c43a93a75b95a76aa6a, UNASSIGN 2023-07-19 15:11:04,424 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ecb2f37e12b8ccab9d1348f4405d83ec, UNASSIGN 2023-07-19 15:11:04,425 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b120837a61f01c43a93a75b95a76aa6a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:04,425 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779464425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779464425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779464425"}]},"ts":"1689779464425"} 2023-07-19 15:11:04,426 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ecb2f37e12b8ccab9d1348f4405d83ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:04,426 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779464426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779464426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779464426"}]},"ts":"1689779464426"} 2023-07-19 15:11:04,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure b120837a61f01c43a93a75b95a76aa6a, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:11:04,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure ecb2f37e12b8ccab9d1348f4405d83ec, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:11:04,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 15:11:04,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:11:04,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b120837a61f01c43a93a75b95a76aa6a, disabling compactions & flushes 2023-07-19 15:11:04,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:11:04,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:11:04,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. after waiting 0 ms 2023-07-19 15:11:04,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:11:04,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:11:04,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ecb2f37e12b8ccab9d1348f4405d83ec, disabling compactions & flushes 2023-07-19 15:11:04,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:11:04,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:11:04,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. after waiting 0 ms 2023-07-19 15:11:04,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:11:04,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:11:04,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:11:04,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec. 2023-07-19 15:11:04,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ecb2f37e12b8ccab9d1348f4405d83ec: 2023-07-19 15:11:04,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:11:04,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:11:04,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:11:04,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a. 2023-07-19 15:11:04,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b120837a61f01c43a93a75b95a76aa6a: 2023-07-19 15:11:04,632 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ecb2f37e12b8ccab9d1348f4405d83ec, regionState=CLOSED 2023-07-19 15:11:04,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779464632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779464632"}]},"ts":"1689779464632"} 2023-07-19 15:11:04,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:11:04,635 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b120837a61f01c43a93a75b95a76aa6a, regionState=CLOSED 2023-07-19 15:11:04,635 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689779464635"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779464635"}]},"ts":"1689779464635"} 2023-07-19 15:11:04,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-19 15:11:04,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure ecb2f37e12b8ccab9d1348f4405d83ec, server=jenkins-hbase4.apache.org,44923,1689779417285 in 205 msec 2023-07-19 15:11:04,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-19 15:11:04,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure b120837a61f01c43a93a75b95a76aa6a, server=jenkins-hbase4.apache.org,37001,1689779417218 in 210 msec 2023-07-19 15:11:04,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ecb2f37e12b8ccab9d1348f4405d83ec, UNASSIGN in 218 msec 2023-07-19 15:11:04,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-19 15:11:04,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b120837a61f01c43a93a75b95a76aa6a, UNASSIGN in 224 msec 2023-07-19 15:11:04,647 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779464647"}]},"ts":"1689779464647"} 2023-07-19 15:11:04,649 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 15:11:04,651 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 15:11:04,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 244 msec 2023-07-19 15:11:04,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 15:11:04,718 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 15:11:04,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 15:11:04,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 15:11:04,722 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 15:11:04,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 15:11:04,723 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 15:11:04,724 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 15:11:04,728 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:11:04,728 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:11:04,730 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/recovered.edits] 2023-07-19 15:11:04,730 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/recovered.edits] 2023-07-19 15:11:04,733 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 15:11:04,733 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 15:11:04,733 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 15:11:04,733 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 15:11:04,734 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 15:11:04,734 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 15:11:04,734 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 15:11:04,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 15:11:04,735 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 15:11:04,735 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 15:11:04,735 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 15:11:04,735 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:04,735 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:04,735 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 15:11:04,735 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:04,735 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/cf/dceb0c2beed9454ab21d68604f42a61e to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/cf/dceb0c2beed9454ab21d68604f42a61e 2023-07-19 15:11:04,735 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:04,736 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/cf/979acaedd53442a9b99cd37aa15a8993 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/cf/979acaedd53442a9b99cd37aa15a8993 2023-07-19 15:11:04,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 15:11:04,740 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec/recovered.edits/9.seqid 2023-07-19 15:11:04,740 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a/recovered.edits/9.seqid 2023-07-19 15:11:04,740 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/ecb2f37e12b8ccab9d1348f4405d83ec 2023-07-19 15:11:04,741 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemState/b120837a61f01c43a93a75b95a76aa6a 2023-07-19 15:11:04,741 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 15:11:04,741 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 15:11:04,742 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-19 15:11:04,746 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307198ff2bc790e304b079127b5038e2c8202 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307198ff2bc790e304b079127b5038e2c8202 2023-07-19 15:11:04,747 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071955835727c83842609aa6557540c03849 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071955835727c83842609aa6557540c03849 2023-07-19 15:11:04,748 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 15:11:04,750 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 15:11:04,753 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 15:11:04,755 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 15:11:04,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 15:11:04,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 15:11:04,757 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779464757"}]},"ts":"9223372036854775807"} 2023-07-19 15:11:04,757 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779464757"}]},"ts":"9223372036854775807"} 2023-07-19 15:11:04,759 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 15:11:04,759 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b120837a61f01c43a93a75b95a76aa6a, NAME => 'testtb-testExportFileSystemState,,1689779447693.b120837a61f01c43a93a75b95a76aa6a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ecb2f37e12b8ccab9d1348f4405d83ec, NAME => 'testtb-testExportFileSystemState,1,1689779447693.ecb2f37e12b8ccab9d1348f4405d83ec.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 15:11:04,759 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 15:11:04,759 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689779464759"}]},"ts":"9223372036854775807"} 2023-07-19 15:11:04,761 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 15:11:04,763 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 15:11:04,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-07-19 15:11:04,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 15:11:04,838 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 15:11:04,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 15:11:04,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 15:11:04,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 15:11:04,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 15:11:04,876 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:41380 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1168140690_1 at /127.0.0.1:33842 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:55590 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2147 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1168140690_1 at /127.0.0.1:41370 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:33882 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:45569 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=411 (was 449), ProcessCount=181 (was 181), AvailableMemoryMB=3274 (was 3289) 2023-07-19 15:11:04,876 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-19 15:11:04,896 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=411, ProcessCount=181, AvailableMemoryMB=3273 2023-07-19 15:11:04,896 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-19 15:11:04,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 15:11:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 15:11:04,902 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 15:11:04,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 15:11:04,903 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 15:11:04,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 15:11:04,905 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:04,905 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a 2023-07-19 15:11:04,906 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff empty. 2023-07-19 15:11:04,906 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a empty. 2023-07-19 15:11:04,906 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:04,906 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a 2023-07-19 15:11:04,906 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 15:11:04,923 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 15:11:04,924 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 098f53e5a4a4cf0f2297b35455fd1cff, NAME => 'testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:11:04,925 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 058a189fc24a652544f0041add00af8a, NAME => 'testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 098f53e5a4a4cf0f2297b35455fd1cff, disabling compactions & flushes 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 058a189fc24a652544f0041add00af8a, disabling compactions & flushes 2023-07-19 15:11:04,955 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:04,955 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. after waiting 0 ms 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. after waiting 0 ms 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:04,955 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:04,955 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 098f53e5a4a4cf0f2297b35455fd1cff: 2023-07-19 15:11:04,955 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 058a189fc24a652544f0041add00af8a: 2023-07-19 15:11:04,958 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 15:11:04,959 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779464959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779464959"}]},"ts":"1689779464959"} 2023-07-19 15:11:04,959 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779464959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779464959"}]},"ts":"1689779464959"} 2023-07-19 15:11:04,961 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 15:11:04,962 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 15:11:04,963 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779464962"}]},"ts":"1689779464962"} 2023-07-19 15:11:04,964 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 15:11:04,967 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:11:04,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:11:04,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:11:04,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:11:04,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:11:04,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=098f53e5a4a4cf0f2297b35455fd1cff, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058a189fc24a652544f0041add00af8a, ASSIGN}] 2023-07-19 15:11:04,971 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058a189fc24a652544f0041add00af8a, ASSIGN 2023-07-19 15:11:04,971 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=098f53e5a4a4cf0f2297b35455fd1cff, ASSIGN 2023-07-19 15:11:04,972 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058a189fc24a652544f0041add00af8a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37001,1689779417218; forceNewPlan=false, retain=false 2023-07-19 15:11:04,972 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=098f53e5a4a4cf0f2297b35455fd1cff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44923,1689779417285; forceNewPlan=false, retain=false 2023-07-19 15:11:05,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 15:11:05,122 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 15:11:05,126 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=098f53e5a4a4cf0f2297b35455fd1cff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,126 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779465125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779465125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779465125"}]},"ts":"1689779465125"} 2023-07-19 15:11:05,126 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=058a189fc24a652544f0041add00af8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779465126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779465126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779465126"}]},"ts":"1689779465126"} 2023-07-19 15:11:05,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 098f53e5a4a4cf0f2297b35455fd1cff, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:11:05,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 058a189fc24a652544f0041add00af8a, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:11:05,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 15:11:05,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:05,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 098f53e5a4a4cf0f2297b35455fd1cff, NAME => 'testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 15:11:05,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. service=AccessControlService 2023-07-19 15:11:05,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:11:05,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:05,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:05,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:05,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:05,288 INFO [StoreOpener-098f53e5a4a4cf0f2297b35455fd1cff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:05,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:05,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 058a189fc24a652544f0041add00af8a, NAME => 'testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 15:11:05,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. service=AccessControlService 2023-07-19 15:11:05,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:11:05,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 058a189fc24a652544f0041add00af8a 2023-07-19 15:11:05,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:05,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 058a189fc24a652544f0041add00af8a 2023-07-19 15:11:05,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 058a189fc24a652544f0041add00af8a 2023-07-19 15:11:05,289 DEBUG [StoreOpener-098f53e5a4a4cf0f2297b35455fd1cff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/cf 2023-07-19 15:11:05,289 DEBUG [StoreOpener-098f53e5a4a4cf0f2297b35455fd1cff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/cf 2023-07-19 15:11:05,290 INFO [StoreOpener-098f53e5a4a4cf0f2297b35455fd1cff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 098f53e5a4a4cf0f2297b35455fd1cff columnFamilyName cf 2023-07-19 15:11:05,290 INFO [StoreOpener-058a189fc24a652544f0041add00af8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 058a189fc24a652544f0041add00af8a 2023-07-19 15:11:05,292 DEBUG [StoreOpener-058a189fc24a652544f0041add00af8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/cf 2023-07-19 15:11:05,292 INFO [StoreOpener-098f53e5a4a4cf0f2297b35455fd1cff-1] regionserver.HStore(310): Store=098f53e5a4a4cf0f2297b35455fd1cff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:11:05,292 DEBUG [StoreOpener-058a189fc24a652544f0041add00af8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/cf 2023-07-19 15:11:05,292 INFO [StoreOpener-058a189fc24a652544f0041add00af8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 058a189fc24a652544f0041add00af8a columnFamilyName cf 2023-07-19 15:11:05,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:05,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:05,293 INFO [StoreOpener-058a189fc24a652544f0041add00af8a-1] regionserver.HStore(310): Store=058a189fc24a652544f0041add00af8a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:11:05,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a 2023-07-19 15:11:05,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a 2023-07-19 15:11:05,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:05,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 058a189fc24a652544f0041add00af8a 2023-07-19 15:11:05,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:11:05,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 098f53e5a4a4cf0f2297b35455fd1cff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73553855, jitterRate=0.0960378497838974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:11:05,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 098f53e5a4a4cf0f2297b35455fd1cff: 2023-07-19 15:11:05,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:11:05,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 058a189fc24a652544f0041add00af8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69089776, jitterRate=0.02951788902282715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:11:05,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff., pid=45, masterSystemTime=1689779465281 2023-07-19 15:11:05,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 058a189fc24a652544f0041add00af8a: 2023-07-19 15:11:05,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:05,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:05,305 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=098f53e5a4a4cf0f2297b35455fd1cff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a., pid=46, masterSystemTime=1689779465284 2023-07-19 15:11:05,305 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779465305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779465305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779465305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779465305"}]},"ts":"1689779465305"} 2023-07-19 15:11:05,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:05,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:05,309 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=058a189fc24a652544f0041add00af8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,309 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779465309"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779465309"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779465309"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779465309"}]},"ts":"1689779465309"} 2023-07-19 15:11:05,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-19 15:11:05,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 098f53e5a4a4cf0f2297b35455fd1cff, server=jenkins-hbase4.apache.org,44923,1689779417285 in 179 msec 2023-07-19 15:11:05,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=098f53e5a4a4cf0f2297b35455fd1cff, ASSIGN in 341 msec 2023-07-19 15:11:05,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-19 15:11:05,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 058a189fc24a652544f0041add00af8a, server=jenkins-hbase4.apache.org,37001,1689779417218 in 181 msec 2023-07-19 15:11:05,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-19 15:11:05,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058a189fc24a652544f0041add00af8a, ASSIGN in 345 msec 2023-07-19 15:11:05,317 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 15:11:05,317 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779465317"}]},"ts":"1689779465317"} 2023-07-19 15:11:05,318 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 15:11:05,321 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 15:11:05,321 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 15:11:05,324 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 15:11:05,326 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:05,326 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:05,326 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:05,326 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:05,328 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:05,328 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:05,328 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:05,328 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:05,343 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 430 msec 2023-07-19 15:11:05,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 15:11:05,507 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 15:11:05,510 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 15:11:05,510 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:05,513 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:11:05,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 15:11:05,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779465525 (current time:1689779465525). 2023-07-19 15:11:05,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:11:05,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x4511d202 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:05,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76e3a302, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:05,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:05,534 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:05,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4511d202 to 127.0.0.1:52285 2023-07-19 15:11:05,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:05,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x07a07b72 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:05,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c6a2846, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:05,544 DEBUG [hconnection-0x277a797a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:05,547 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:05,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:05,553 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:05,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07a07b72 to 127.0.0.1:52285 2023-07-19 15:11:05,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:05,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 15:11:05,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:11:05,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 15:11:05,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 15:11:05,558 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 15:11:05,558 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689780065558 2023-07-19 15:11:05,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 15:11:05,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 15:11:05,560 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:11:05,560 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:11:05,560 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 15:11:05,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 15:11:05,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-19 15:11:05,562 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 15:11:05,563 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689780065563 2023-07-19 15:11:05,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,584 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 15:11:05,584 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:05,585 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 15:11:05,585 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 15:11:05,585 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,586 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,594 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:05,594 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:05,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:05,594 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,594 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:05,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:05,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:05,595 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,595 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,595 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,595 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:11:05,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,596 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 15:11:05,596 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 15:11:05,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,596 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:05,596 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 15:11:05,598 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 15:11:05,596 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:05,598 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 15:11:05,599 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 15:11:05,599 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 15:11:05,598 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:05,599 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 15:11:05,602 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 15:11:05,602 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 15:11:05,602 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 15:11:05,599 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 15:11:05,609 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,609 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,609 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,609 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:05,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:05,615 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:05,615 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,615 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,615 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:05,615 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:05,615 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,616 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 15:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@562f548b[Count = 1] remaining members to acquire global barrier 2023-07-19 15:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:05,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 15:11:05,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@562f548b[Count = 0] remaining members to acquire global barrier 2023-07-19 15:11:05,619 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 15:11:05,619 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 15:11:05,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 15:11:05,621 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 15:11:05,621 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,621 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:11:05,621 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 15:11:05,621 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:11:05,621 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:11:05,621 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:05,622 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,622 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:05,622 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. started... 2023-07-19 15:11:05,622 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. started... 2023-07-19 15:11:05,622 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:11:05,622 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:11:05,622 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:11:05,623 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 098f53e5a4a4cf0f2297b35455fd1cff: 2023-07-19 15:11:05,623 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 058a189fc24a652544f0041add00af8a: 2023-07-19 15:11:05,624 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,624 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,625 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:11:05,625 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:11:05,625 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:11:05,625 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:11:05,629 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 15:11:05,629 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:05,629 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 15:11:05,657 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. completed. 2023-07-19 15:11:05,658 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:11:05,658 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. completed. 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,658 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 15:11:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:11:05,660 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,660 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 15:11:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,660 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:05,660 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:05,660 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 15:11:05,662 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 15:11:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:05,662 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:05,662 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,662 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 15:11:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:05,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 15:11:05,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,663 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:11:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:11:05,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 15:11:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:11:05,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 15:11:05,670 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 15:11:05,670 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:11:05,670 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:11:05,670 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,670 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:11:05,671 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,671 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,671 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,671 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:05,671 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,671 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:05,672 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:05,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:05,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:05,672 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,673 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,673 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,675 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,675 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,676 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,680 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,680 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:05,680 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:05,680 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:05,680 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,680 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:05,680 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:05,680 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 15:11:05,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:05,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,680 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:05,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:11:05,680 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:05,680 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,682 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:05,680 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:05,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:05,682 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:05,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:05,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:05,683 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,683 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,683 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,683 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,683 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,683 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 15:11:05,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:05,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,751 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 15:11:05,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,752 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:05,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689779465558Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689779465692 (+134 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689779465692Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689779465692Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689779465699 (+7 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689779465711 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689779465751 (+40 ms) 2023-07-19 15:11:05,755 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 15:11:05,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 196 msec 2023-07-19 15:11:05,864 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:05,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 15:11:05,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:11:05,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44923] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:11:05,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37001] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:11:05,872 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 15:11:05,872 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:05,872 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:11:05,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 15:11:05,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779465882 (current time:1689779465882). 2023-07-19 15:11:05,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:11:05,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x6486ceed to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:05,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@243c88cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:05,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:05,896 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:05,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6486ceed to 127.0.0.1:52285 2023-07-19 15:11:05,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:05,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x78cbe0cb to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:05,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ae8a899, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:05,907 DEBUG [hconnection-0x6a5237e9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:05,909 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:05,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:05,914 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:05,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78cbe0cb to 127.0.0.1:52285 2023-07-19 15:11:05,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:05,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 15:11:05,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:11:05,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 15:11:05,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 15:11:05,919 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 15:11:05,920 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689780065920 2023-07-19 15:11:05,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 15:11:05,920 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 15:11:05,921 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:11:05,921 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:11:05,924 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 15:11:05,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 15:11:05,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-19 15:11:05,926 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 15:11:05,927 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689780065927 2023-07-19 15:11:05,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 15:11:05,940 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 15:11:05,940 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:05,942 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 15:11:05,942 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 15:11:05,942 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,942 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,944 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,944 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:05,944 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:05,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:05,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:05,944 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:05,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:05,944 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,944 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,945 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,945 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:11:05,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 15:11:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,945 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 15:11:05,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 15:11:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 15:11:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 15:11:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:05,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,947 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 15:11:05,947 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 15:11:05,947 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 15:11:05,947 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 15:11:05,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 15:11:05,948 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 15:11:05,948 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:05,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 15:11:05,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,949 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 15:11:05,949 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 15:11:05,949 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 15:11:05,949 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 15:11:05,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 15:11:05,949 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 15:11:05,950 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:05,951 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 15:11:05,951 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 15:11:05,951 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 15:11:05,951 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,951 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:05,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:05,952 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,952 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,952 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:05,952 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:05,954 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,954 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,954 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:05,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:05,954 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,954 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:05,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 15:11:05,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:05,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 15:11:05,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@432196f4[Count = 1] remaining members to acquire global barrier 2023-07-19 15:11:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:05,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 15:11:05,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:05,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:05,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 15:11:05,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@432196f4[Count = 0] remaining members to acquire global barrier 2023-07-19 15:11:05,958 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 15:11:05,958 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,959 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,959 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,959 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 15:11:05,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 15:11:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:11:05,960 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:11:05,960 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. started... 2023-07-19 15:11:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 15:11:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 15:11:05,960 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:11:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:11:05,960 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:11:05,960 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 058a189fc24a652544f0041add00af8a 1/1 column families, dataSize=2.74 KB heapSize=6.16 KB 2023-07-19 15:11:05,960 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. started... 2023-07-19 15:11:05,961 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:05,961 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:11:05,961 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 098f53e5a4a4cf0f2297b35455fd1cff 1/1 column families, dataSize=534 B heapSize=1.38 KB 2023-07-19 15:11:05,962 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 15:11:05,962 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:05,962 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 15:11:05,981 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719af8356c91c1245c4bb25497da59c83d9 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719af8356c91c1245c4bb25497da59c83d9 2023-07-19 15:11:05,989 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719bc7077004baa4149876db548eec8b947 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719bc7077004baa4149876db548eec8b947 2023-07-19 15:11:05,991 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=534, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/.tmp/cf/4b96570e49004d36a86488ba74cf490e 2023-07-19 15:11:05,997 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/.tmp/cf/4b96570e49004d36a86488ba74cf490e as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/cf/4b96570e49004d36a86488ba74cf490e 2023-07-19 15:11:06,007 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/cf/4b96570e49004d36a86488ba74cf490e, entries=8, sequenceid=6, filesize=6.2 K 2023-07-19 15:11:06,009 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~534 B/534, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 098f53e5a4a4cf0f2297b35455fd1cff in 48ms, sequenceid=6, compaction requested=false 2023-07-19 15:11:06,009 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 15:11:06,010 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 098f53e5a4a4cf0f2297b35455fd1cff: 2023-07-19 15:11:06,010 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 15:11:06,010 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:11:06,010 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/cf/4b96570e49004d36a86488ba74cf490e] hfiles 2023-07-19 15:11:06,010 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/cf/4b96570e49004d36a86488ba74cf490e for snapshot=snaptb0-testConsecutiveExports 2023-07-19 15:11:06,010 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/.tmp/cf/4caed1bbee044608b1eec601269d1801 2023-07-19 15:11:06,018 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/.tmp/cf/4caed1bbee044608b1eec601269d1801 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/cf/4caed1bbee044608b1eec601269d1801 2023-07-19 15:11:06,021 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:06,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 15:11:06,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:06,022 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:11:06,023 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/cf/4caed1bbee044608b1eec601269d1801, entries=42, sequenceid=6, filesize=11.9 K 2023-07-19 15:11:06,024 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.74 KB/2802, heapSize ~6.14 KB/6288, currentSize=0 B/0 for 058a189fc24a652544f0041add00af8a in 64ms, sequenceid=6, compaction requested=false 2023-07-19 15:11:06,032 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 058a189fc24a652544f0041add00af8a: 2023-07-19 15:11:06,032 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 15:11:06,032 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:11:06,032 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/cf/4caed1bbee044608b1eec601269d1801] hfiles 2023-07-19 15:11:06,032 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/cf/4caed1bbee044608b1eec601269d1801 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 15:11:06,036 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. completed. 2023-07-19 15:11:06,036 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:11:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:11:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 15:11:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:11:06,038 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 15:11:06,038 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,038 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:06,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:06,038 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 15:11:06,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:06,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:06,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 15:11:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 15:11:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:11:06,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 15:11:06,053 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. completed. 2023-07-19 15:11:06,053 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:06,053 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:11:06,054 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:11:06,054 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,054 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 15:11:06,054 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:11:06,056 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,056 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 15:11:06,056 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:06,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:06,056 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 15:11:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 15:11:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 15:11:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:11:06,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 15:11:06,061 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 15:11:06,061 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:11:06,061 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:11:06,061 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 15:11:06,061 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:11:06,063 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,063 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,063 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:06,063 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:06,063 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:06,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,063 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:06,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,064 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:06,064 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 15:11:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,064 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:06,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:06,064 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 15:11:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:06,066 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 15:11:06,066 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,067 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,078 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,078 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:06,078 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:06,078 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:06,078 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:06,078 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:06,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:06,078 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:06,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:06,078 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,078 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:06,080 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:06,078 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:06,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 15:11:06,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:06,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 15:11:06,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:06,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 15:11:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:06,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:11:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:06,080 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:06,081 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:06,081 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:06,081 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:06,081 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:06,081 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,081 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719bc7077004baa4149876db548eec8b947, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719af8356c91c1245c4bb25497da59c83d9] mob files 2023-07-19 15:11:06,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719bc7077004baa4149876db548eec8b947 2023-07-19 15:11:06,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719af8356c91c1245c4bb25497da59c83d9 2023-07-19 15:11:06,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 15:11:06,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,129 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 15:11:06,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,130 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689779465920Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689779466088 (+168 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689779466088Loading Region manifests for snaptb0-testConsecutiveExports at 1689779466089 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689779466092 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689779466100 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689779466129 (+29 ms) 2023-07-19 15:11:06,133 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 15:11:06,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 212 msec 2023-07-19 15:11:06,223 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:06,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 15:11:06,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:11:06,224 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224 2023-07-19 15:11:06,224 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224, srcFsUri=hdfs://localhost:44363, srcDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:11:06,249 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:11:06,249 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5b2e25ff, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,249 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983, snapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 15:11:06,258 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 15:11:06,272 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:06,272 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:06,273 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:06,273 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:07,227 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-6028067864862548543.jar 2023-07-19 15:11:07,228 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:07,228 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:07,319 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-941652305714435238.jar 2023-07-19 15:11:07,319 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:07,319 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:07,320 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:07,320 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:07,321 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:07,321 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:07,321 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 15:11:07,322 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 15:11:07,322 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 15:11:07,322 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 15:11:07,323 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 15:11:07,323 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 15:11:07,324 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 15:11:07,324 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 15:11:07,324 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 15:11:07,325 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 15:11:07,325 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:07,326 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:07,326 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:11:07,326 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:07,327 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:07,327 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:11:07,328 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:11:07,909 WARN [Listener at jenkins-hbase4.apache.org/37699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 15:11:07,913 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 15:11:07,916 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 15:11:08,940 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:11:08,940 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:11:08,943 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0002_000001 (auth:SIMPLE) 2023-07-19 15:11:09,110 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0003_000001 (auth:SIMPLE) 2023-07-19 15:11:10,234 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 15:11:13,513 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0003_000001 (auth:SIMPLE) 2023-07-19 15:11:15,801 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0003_000001 (auth:SIMPLE) 2023-07-19 15:11:18,828 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0003_000001 (auth:SIMPLE) 2023-07-19 15:11:20,332 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 15:11:20,333 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 15:11:20,337 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 15:11:20,337 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 15:11:20,338 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 15:11:20,338 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 15:11:20,340 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 15:11:20,340 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 15:11:20,340 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3a029d6 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 15:11:20,340 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 15:11:20,340 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 15:11:20,341 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224, srcFsUri=hdfs://localhost:44363, srcDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:11:20,364 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:11:20,364 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@169f64bb, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 15:11:20,364 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983, snapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 15:11:20,373 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 15:11:20,385 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:20,385 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:20,385 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:20,386 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:21,270 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-7550243212490439027.jar 2023-07-19 15:11:21,270 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:21,271 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:21,338 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-1069591364300732356.jar 2023-07-19 15:11:21,339 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:21,339 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:21,340 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:21,340 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:21,341 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:21,341 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:21,341 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 15:11:21,342 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 15:11:21,342 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 15:11:21,342 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 15:11:21,343 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 15:11:21,343 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 15:11:21,344 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 15:11:21,344 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 15:11:21,344 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 15:11:21,345 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 15:11:21,345 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:21,346 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:21,346 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:11:21,346 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:21,347 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:21,347 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:11:21,348 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:11:22,131 WARN [Listener at jenkins-hbase4.apache.org/37699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 15:11:22,133 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 15:11:22,135 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 15:11:25,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:11:25,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:11:25,022 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0003_000001 (auth:SIMPLE) 2023-07-19 15:11:25,810 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0004_000001 (auth:SIMPLE) 2023-07-19 15:11:30,204 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0004_000001 (auth:SIMPLE) 2023-07-19 15:11:32,460 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0004_000001 (auth:SIMPLE) 2023-07-19 15:11:35,087 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0004_000001 (auth:SIMPLE) 2023-07-19 15:11:36,455 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 15:11:36,456 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 15:11:36,483 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 15:11:36,484 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 15:11:36,484 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 15:11:36,484 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 15:11:36,492 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 15:11:36,492 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 15:11:36,492 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3a029d6 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 15:11:36,493 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 15:11:36,493 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/local-export-1689779466224/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 15:11:36,506 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 15:11:36,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 15:11:36,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 15:11:36,516 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779496516"}]},"ts":"1689779496516"} 2023-07-19 15:11:36,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 15:11:36,518 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 15:11:36,519 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 15:11:36,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=098f53e5a4a4cf0f2297b35455fd1cff, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058a189fc24a652544f0041add00af8a, UNASSIGN}] 2023-07-19 15:11:36,523 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058a189fc24a652544f0041add00af8a, UNASSIGN 2023-07-19 15:11:36,524 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=058a189fc24a652544f0041add00af8a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:36,524 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779496524"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779496524"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779496524"}]},"ts":"1689779496524"} 2023-07-19 15:11:36,526 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=098f53e5a4a4cf0f2297b35455fd1cff, UNASSIGN 2023-07-19 15:11:36,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 058a189fc24a652544f0041add00af8a, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:11:36,528 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=098f53e5a4a4cf0f2297b35455fd1cff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:36,529 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779496528"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779496528"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779496528"}]},"ts":"1689779496528"} 2023-07-19 15:11:36,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 098f53e5a4a4cf0f2297b35455fd1cff, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:11:36,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 15:11:36,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 058a189fc24a652544f0041add00af8a 2023-07-19 15:11:36,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 058a189fc24a652544f0041add00af8a, disabling compactions & flushes 2023-07-19 15:11:36,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:36,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:36,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. after waiting 0 ms 2023-07-19 15:11:36,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:36,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:36,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 098f53e5a4a4cf0f2297b35455fd1cff, disabling compactions & flushes 2023-07-19 15:11:36,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:36,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:36,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. after waiting 0 ms 2023-07-19 15:11:36,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:36,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:11:36,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:11:36,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a. 2023-07-19 15:11:36,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 058a189fc24a652544f0041add00af8a: 2023-07-19 15:11:36,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 058a189fc24a652544f0041add00af8a 2023-07-19 15:11:36,715 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=058a189fc24a652544f0041add00af8a, regionState=CLOSED 2023-07-19 15:11:36,715 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779496715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779496715"}]},"ts":"1689779496715"} 2023-07-19 15:11:36,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 15:11:36,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 058a189fc24a652544f0041add00af8a, server=jenkins-hbase4.apache.org,37001,1689779417218 in 189 msec 2023-07-19 15:11:36,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058a189fc24a652544f0041add00af8a, UNASSIGN in 201 msec 2023-07-19 15:11:36,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:11:36,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:11:36,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff. 2023-07-19 15:11:36,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 098f53e5a4a4cf0f2297b35455fd1cff: 2023-07-19 15:11:36,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:36,742 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=098f53e5a4a4cf0f2297b35455fd1cff, regionState=CLOSED 2023-07-19 15:11:36,742 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689779496742"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779496742"}]},"ts":"1689779496742"} 2023-07-19 15:11:36,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 15:11:36,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 098f53e5a4a4cf0f2297b35455fd1cff, server=jenkins-hbase4.apache.org,44923,1689779417285 in 212 msec 2023-07-19 15:11:36,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-19 15:11:36,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=098f53e5a4a4cf0f2297b35455fd1cff, UNASSIGN in 231 msec 2023-07-19 15:11:36,765 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779496765"}]},"ts":"1689779496765"} 2023-07-19 15:11:36,767 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 15:11:36,769 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 15:11:36,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 264 msec 2023-07-19 15:11:36,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 15:11:36,821 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 15:11:36,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 15:11:36,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 15:11:36,826 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 15:11:36,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 15:11:36,829 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 15:11:36,833 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 15:11:36,837 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 15:11:36,837 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 15:11:36,837 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 15:11:36,837 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 15:11:36,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 15:11:36,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 15:11:36,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 15:11:36,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 15:11:36,839 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:36,840 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 15:11:36,840 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 15:11:36,840 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:36,840 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 15:11:36,840 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 15:11:36,840 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:36,840 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:36,840 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:36,843 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a 2023-07-19 15:11:36,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 15:11:36,845 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/recovered.edits] 2023-07-19 15:11:36,846 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/recovered.edits] 2023-07-19 15:11:36,857 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/cf/4caed1bbee044608b1eec601269d1801 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/cf/4caed1bbee044608b1eec601269d1801 2023-07-19 15:11:36,858 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/cf/4b96570e49004d36a86488ba74cf490e to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/cf/4b96570e49004d36a86488ba74cf490e 2023-07-19 15:11:36,861 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a/recovered.edits/9.seqid 2023-07-19 15:11:36,862 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/058a189fc24a652544f0041add00af8a 2023-07-19 15:11:36,866 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff/recovered.edits/9.seqid 2023-07-19 15:11:36,867 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testConsecutiveExports/098f53e5a4a4cf0f2297b35455fd1cff 2023-07-19 15:11:36,867 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 15:11:36,868 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 15:11:36,869 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-19 15:11:36,874 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719bc7077004baa4149876db548eec8b947 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719bc7077004baa4149876db548eec8b947 2023-07-19 15:11:36,879 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719af8356c91c1245c4bb25497da59c83d9 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719af8356c91c1245c4bb25497da59c83d9 2023-07-19 15:11:36,882 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 15:11:36,884 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 15:11:36,887 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 15:11:36,902 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 15:11:36,904 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 15:11:36,904 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 15:11:36,904 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779496904"}]},"ts":"9223372036854775807"} 2023-07-19 15:11:36,904 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779496904"}]},"ts":"9223372036854775807"} 2023-07-19 15:11:36,908 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 15:11:36,909 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 098f53e5a4a4cf0f2297b35455fd1cff, NAME => 'testtb-testConsecutiveExports,,1689779464898.098f53e5a4a4cf0f2297b35455fd1cff.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 058a189fc24a652544f0041add00af8a, NAME => 'testtb-testConsecutiveExports,1,1689779464898.058a189fc24a652544f0041add00af8a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 15:11:36,909 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 15:11:36,909 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689779496909"}]},"ts":"9223372036854775807"} 2023-07-19 15:11:36,915 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 15:11:36,927 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 15:11:36,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 105 msec 2023-07-19 15:11:36,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 15:11:36,946 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 15:11:36,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 15:11:36,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 15:11:36,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 15:11:36,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 15:11:37,028 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 765), OpenFileDescriptor=898 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=375 (was 411), ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=3500 (was 3273) - AvailableMemoryMB LEAK? - 2023-07-19 15:11:37,028 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-19 15:11:37,051 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=375, ProcessCount=183, AvailableMemoryMB=3498 2023-07-19 15:11:37,051 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-19 15:11:37,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 15:11:37,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,057 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 15:11:37,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 15:11:37,058 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 15:11:37,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 15:11:37,061 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11 2023-07-19 15:11:37,061 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:11:37,062 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11 empty. 2023-07-19 15:11:37,062 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8 empty. 2023-07-19 15:11:37,063 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11 2023-07-19 15:11:37,063 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:11:37,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 15:11:37,074 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 15:11:37,075 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 047fbe9aba6d078d025a86d2dc7af2f8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:11:37,075 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => f535968f3531c233fb85981e7ff50e11, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:11:37,096 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:37,096 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 047fbe9aba6d078d025a86d2dc7af2f8, disabling compactions & flushes 2023-07-19 15:11:37,096 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,096 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,096 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. after waiting 0 ms 2023-07-19 15:11:37,097 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,097 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,097 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 047fbe9aba6d078d025a86d2dc7af2f8: 2023-07-19 15:11:37,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:37,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing f535968f3531c233fb85981e7ff50e11, disabling compactions & flushes 2023-07-19 15:11:37,102 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:37,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:37,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. after waiting 0 ms 2023-07-19 15:11:37,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:37,102 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:37,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for f535968f3531c233fb85981e7ff50e11: 2023-07-19 15:11:37,105 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 15:11:37,106 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779497106"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779497106"}]},"ts":"1689779497106"} 2023-07-19 15:11:37,106 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779497106"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779497106"}]},"ts":"1689779497106"} 2023-07-19 15:11:37,126 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 15:11:37,128 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 15:11:37,128 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779497128"}]},"ts":"1689779497128"} 2023-07-19 15:11:37,130 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 15:11:37,134 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:11:37,135 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:11:37,135 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:11:37,135 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:11:37,136 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:11:37,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=047fbe9aba6d078d025a86d2dc7af2f8, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f535968f3531c233fb85981e7ff50e11, ASSIGN}] 2023-07-19 15:11:37,139 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f535968f3531c233fb85981e7ff50e11, ASSIGN 2023-07-19 15:11:37,139 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=047fbe9aba6d078d025a86d2dc7af2f8, ASSIGN 2023-07-19 15:11:37,143 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f535968f3531c233fb85981e7ff50e11, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37001,1689779417218; forceNewPlan=false, retain=false 2023-07-19 15:11:37,143 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=047fbe9aba6d078d025a86d2dc7af2f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44923,1689779417285; forceNewPlan=false, retain=false 2023-07-19 15:11:37,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 15:11:37,293 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 15:11:37,297 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=047fbe9aba6d078d025a86d2dc7af2f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779497297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779497297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779497297"}]},"ts":"1689779497297"} 2023-07-19 15:11:37,297 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f535968f3531c233fb85981e7ff50e11, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,298 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779497297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779497297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779497297"}]},"ts":"1689779497297"} 2023-07-19 15:11:37,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 047fbe9aba6d078d025a86d2dc7af2f8, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:11:37,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure f535968f3531c233fb85981e7ff50e11, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:11:37,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 15:11:37,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 047fbe9aba6d078d025a86d2dc7af2f8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 15:11:37,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. service=AccessControlService 2023-07-19 15:11:37,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:11:37,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:11:37,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:37,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:11:37,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:11:37,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f535968f3531c233fb85981e7ff50e11, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 15:11:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. service=AccessControlService 2023-07-19 15:11:37,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:11:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f535968f3531c233fb85981e7ff50e11 2023-07-19 15:11:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:37,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f535968f3531c233fb85981e7ff50e11 2023-07-19 15:11:37,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f535968f3531c233fb85981e7ff50e11 2023-07-19 15:11:37,463 INFO [StoreOpener-047fbe9aba6d078d025a86d2dc7af2f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:11:37,463 INFO [StoreOpener-f535968f3531c233fb85981e7ff50e11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f535968f3531c233fb85981e7ff50e11 2023-07-19 15:11:37,465 DEBUG [StoreOpener-047fbe9aba6d078d025a86d2dc7af2f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/cf 2023-07-19 15:11:37,465 DEBUG [StoreOpener-f535968f3531c233fb85981e7ff50e11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/cf 2023-07-19 15:11:37,465 DEBUG [StoreOpener-f535968f3531c233fb85981e7ff50e11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/cf 2023-07-19 15:11:37,465 DEBUG [StoreOpener-047fbe9aba6d078d025a86d2dc7af2f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/cf 2023-07-19 15:11:37,466 INFO [StoreOpener-f535968f3531c233fb85981e7ff50e11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f535968f3531c233fb85981e7ff50e11 columnFamilyName cf 2023-07-19 15:11:37,467 INFO [StoreOpener-047fbe9aba6d078d025a86d2dc7af2f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 047fbe9aba6d078d025a86d2dc7af2f8 columnFamilyName cf 2023-07-19 15:11:37,474 INFO [StoreOpener-f535968f3531c233fb85981e7ff50e11-1] regionserver.HStore(310): Store=f535968f3531c233fb85981e7ff50e11/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:11:37,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11 2023-07-19 15:11:37,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11 2023-07-19 15:11:37,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f535968f3531c233fb85981e7ff50e11 2023-07-19 15:11:37,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:11:37,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f535968f3531c233fb85981e7ff50e11; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63511797, jitterRate=-0.05360047519207001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:11:37,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f535968f3531c233fb85981e7ff50e11: 2023-07-19 15:11:37,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11., pid=61, masterSystemTime=1689779497455 2023-07-19 15:11:37,485 INFO [StoreOpener-047fbe9aba6d078d025a86d2dc7af2f8-1] regionserver.HStore(310): Store=047fbe9aba6d078d025a86d2dc7af2f8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:11:37,487 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f535968f3531c233fb85981e7ff50e11, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,487 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779497487"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779497487"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779497487"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779497487"}]},"ts":"1689779497487"} 2023-07-19 15:11:37,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:11:37,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:37,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:37,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:11:37,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-19 15:11:37,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure f535968f3531c233fb85981e7ff50e11, server=jenkins-hbase4.apache.org,37001,1689779417218 in 186 msec 2023-07-19 15:11:37,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:11:37,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f535968f3531c233fb85981e7ff50e11, ASSIGN in 357 msec 2023-07-19 15:11:37,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:11:37,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 047fbe9aba6d078d025a86d2dc7af2f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72577924, jitterRate=0.08149534463882446}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:11:37,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 047fbe9aba6d078d025a86d2dc7af2f8: 2023-07-19 15:11:37,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8., pid=60, masterSystemTime=1689779497454 2023-07-19 15:11:37,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,499 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=047fbe9aba6d078d025a86d2dc7af2f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,499 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779497498"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779497498"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779497498"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779497498"}]},"ts":"1689779497498"} 2023-07-19 15:11:37,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-19 15:11:37,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 047fbe9aba6d078d025a86d2dc7af2f8, server=jenkins-hbase4.apache.org,44923,1689779417285 in 200 msec 2023-07-19 15:11:37,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-19 15:11:37,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=047fbe9aba6d078d025a86d2dc7af2f8, ASSIGN in 366 msec 2023-07-19 15:11:37,505 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 15:11:37,505 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779497505"}]},"ts":"1689779497505"} 2023-07-19 15:11:37,507 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 15:11:37,509 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 15:11:37,510 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 15:11:37,516 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 15:11:37,518 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:37,518 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:37,518 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:37,518 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:37,519 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:37,519 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:37,519 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:37,519 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:37,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 467 msec 2023-07-19 15:11:37,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 15:11:37,663 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 15:11:37,665 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,665 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,668 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:11:37,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 15:11:37,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779497697 (current time:1689779497697). 2023-07-19 15:11:37,697 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 15:11:37,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:11:37,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x5dd161bb to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:37,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@572baeef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:37,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:37,712 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:37,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dd161bb to 127.0.0.1:52285 2023-07-19 15:11:37,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:37,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x61f873e1 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:37,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37f20adc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:37,721 DEBUG [hconnection-0x3d24861b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:37,722 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:37,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:37,728 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:37,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61f873e1 to 127.0.0.1:52285 2023-07-19 15:11:37,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:37,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 15:11:37,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:11:37,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 15:11:37,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 15:11:37,734 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 15:11:37,735 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689780097735 2023-07-19 15:11:37,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 15:11:37,735 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,737 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:11:37,737 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:11:37,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 15:11:37,738 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 15:11:37,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-19 15:11:37,740 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 15:11:37,740 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689780097740 2023-07-19 15:11:37,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,776 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 15:11:37,776 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:37,777 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 15:11:37,777 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 15:11:37,778 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,778 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,779 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:37,779 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:37,779 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:37,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:37,779 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:37,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,780 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:37,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:37,780 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 15:11:37,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,781 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 15:11:37,781 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,781 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:11:37,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 15:11:37,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 15:11:37,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 15:11:37,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 15:11:37,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,783 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 15:11:37,783 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:37,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,803 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,804 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 15:11:37,804 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:37,796 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 15:11:37,806 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 15:11:37,806 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 15:11:37,806 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 15:11:37,804 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 15:11:37,806 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:37,806 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 15:11:37,808 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 15:11:37,808 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 15:11:37,808 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 15:11:37,808 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 15:11:37,810 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,812 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,812 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:37,813 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,813 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:37,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 15:11:37,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4308ae3e[Count = 1] remaining members to acquire global barrier 2023-07-19 15:11:37,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:37,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:37,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:37,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 15:11:37,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4308ae3e[Count = 0] remaining members to acquire global barrier 2023-07-19 15:11:37,822 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 15:11:37,822 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,823 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,823 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 15:11:37,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 15:11:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 15:11:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:11:37,824 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,824 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,825 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:11:37,825 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,826 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 15:11:37,828 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 15:11:37,829 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:37,829 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 15:11:37,837 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:37,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 15:11:37,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:37,838 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:11:37,841 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:11:37,841 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:11:37,841 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:11:37,841 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:11:37,841 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,841 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:37,841 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. started... 2023-07-19 15:11:37,841 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. started... 2023-07-19 15:11:37,843 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f535968f3531c233fb85981e7ff50e11: 2023-07-19 15:11:37,843 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,843 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:11:37,844 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:11:37,844 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 047fbe9aba6d078d025a86d2dc7af2f8: 2023-07-19 15:11:37,844 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,844 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:11:37,844 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:11:37,891 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. completed. 2023-07-19 15:11:37,891 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:37,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:11:37,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:11:37,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 15:11:37,891 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:11:37,894 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. completed. 2023-07-19 15:11:37,894 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:37,894 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:11:37,895 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:11:37,895 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,895 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 15:11:37,895 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:11:37,897 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 15:11:37,897 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,897 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:37,897 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 15:11:37,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:37,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:37,900 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 15:11:37,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 15:11:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:11:37,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 15:11:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:11:37,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 15:11:37,913 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 15:11:37,913 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:11:37,913 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:11:37,913 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,913 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:11:37,917 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,917 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,917 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,917 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:37,917 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:37,917 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:37,918 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,919 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:37,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:37,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:37,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:37,919 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:37,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:37,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,920 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:37,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:37,923 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,923 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,924 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,928 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:37,928 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:37,928 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:37,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:37,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:37,928 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:37,929 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:37,929 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:37,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:37,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:37,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:37,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:37,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:37,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:11:37,930 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,930 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,930 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,930 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,930 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,930 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:37,930 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:37,931 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,932 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:37,932 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:37,932 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,932 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:37,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 15:11:38,039 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:38,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 15:11:38,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:38,040 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 15:11:38,340 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:38,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 15:11:38,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:38,342 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 15:11:38,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:38,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:38,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:38,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 15:11:38,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:38,451 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:38,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689779497735Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689779498376 (+641 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689779498376Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689779498376Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689779498381 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689779498404 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689779498450 (+46 ms) 2023-07-19 15:11:38,454 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 15:11:38,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 718 msec 2023-07-19 15:11:38,842 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:38,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 15:11:38,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:11:38,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44923] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:11:38,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37001] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:11:38,876 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:38,876 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:38,876 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:11:38,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 15:11:38,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779498889 (current time:1689779498889). 2023-07-19 15:11:38,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:11:38,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x07ec9aca to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:38,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20413d2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:38,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:38,930 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:38,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07ec9aca to 127.0.0.1:52285 2023-07-19 15:11:38,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:38,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x1d376a0d to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:38,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7eee89ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:38,961 DEBUG [hconnection-0x576f7b0e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:38,969 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:38,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:38,980 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:38,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d376a0d to 127.0.0.1:52285 2023-07-19 15:11:38,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:38,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 15:11:38,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:11:38,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 15:11:38,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 15:11:38,987 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 15:11:38,988 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689780098988 2023-07-19 15:11:38,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 15:11:38,988 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:38,991 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 15:11:38,992 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:11:38,992 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:11:38,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 15:11:38,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-19 15:11:38,995 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 15:11:38,996 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689780098996 2023-07-19 15:11:39,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,016 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 15:11:39,016 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:39,018 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 15:11:39,018 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 15:11:39,019 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,019 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,020 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:39,020 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:39,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:39,021 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,021 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:39,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:39,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,022 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,022 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,029 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,029 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:11:39,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 15:11:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 15:11:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 15:11:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 15:11:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 15:11:39,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 15:11:39,054 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,055 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 15:11:39,055 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:39,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,057 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 15:11:39,057 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:39,057 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 15:11:39,057 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:39,060 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 15:11:39,060 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 15:11:39,060 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 15:11:39,060 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 15:11:39,060 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 15:11:39,060 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 15:11:39,060 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 15:11:39,060 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 15:11:39,061 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 15:11:39,062 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,062 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:39,063 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:39,064 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,064 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:39,064 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,064 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,065 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,065 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:39,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 15:11:39,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36f7c56d[Count = 1] remaining members to acquire global barrier 2023-07-19 15:11:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:39,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 15:11:39,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36f7c56d[Count = 0] remaining members to acquire global barrier 2023-07-19 15:11:39,070 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 15:11:39,071 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 15:11:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 15:11:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 15:11:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:11:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 15:11:39,074 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:11:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:11:39,075 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:39,075 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 15:11:39,075 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:39,075 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 15:11:39,075 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,075 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:11:39,075 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. started... 2023-07-19 15:11:39,076 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f535968f3531c233fb85981e7ff50e11 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 15:11:39,076 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:11:39,076 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:11:39,076 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:39,080 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. started... 2023-07-19 15:11:39,080 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 047fbe9aba6d078d025a86d2dc7af2f8 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 15:11:39,092 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:39,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 15:11:39,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:39,093 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:11:39,125 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719cd7a40cc3af948f3ae2ae7589051d27a to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719cd7a40cc3af948f3ae2ae7589051d27a 2023-07-19 15:11:39,156 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719e0e65a8c1da94dcfba958ab54276627b to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719e0e65a8c1da94dcfba958ab54276627b 2023-07-19 15:11:39,171 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/.tmp/cf/99669d001ee742988ffd2d6905ba1c39 2023-07-19 15:11:39,178 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/.tmp/cf/99669d001ee742988ffd2d6905ba1c39 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/cf/99669d001ee742988ffd2d6905ba1c39 2023-07-19 15:11:39,188 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/cf/99669d001ee742988ffd2d6905ba1c39, entries=4, sequenceid=6, filesize=5.6 K 2023-07-19 15:11:39,189 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 047fbe9aba6d078d025a86d2dc7af2f8 in 109ms, sequenceid=6, compaction requested=false 2023-07-19 15:11:39,191 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 047fbe9aba6d078d025a86d2dc7af2f8: 2023-07-19 15:11:39,191 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,191 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:11:39,191 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/cf/99669d001ee742988ffd2d6905ba1c39] hfiles 2023-07-19 15:11:39,192 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/cf/99669d001ee742988ffd2d6905ba1c39 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,199 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/.tmp/cf/4a3fd3c9d9dd4ce38cd9419521322535 2023-07-19 15:11:39,209 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/.tmp/cf/4a3fd3c9d9dd4ce38cd9419521322535 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/cf/4a3fd3c9d9dd4ce38cd9419521322535 2023-07-19 15:11:39,218 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/cf/4a3fd3c9d9dd4ce38cd9419521322535, entries=46, sequenceid=6, filesize=13.3 K 2023-07-19 15:11:39,219 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for f535968f3531c233fb85981e7ff50e11 in 143ms, sequenceid=6, compaction requested=false 2023-07-19 15:11:39,219 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f535968f3531c233fb85981e7ff50e11: 2023-07-19 15:11:39,219 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,220 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:11:39,220 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/cf/4a3fd3c9d9dd4ce38cd9419521322535] hfiles 2023-07-19 15:11:39,220 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/cf/4a3fd3c9d9dd4ce38cd9419521322535 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,227 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. completed. 2023-07-19 15:11:39,227 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:11:39,227 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:11:39,227 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:11:39,227 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,227 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 15:11:39,227 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:11:39,229 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,229 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 15:11:39,229 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:39,229 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 15:11:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:11:39,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 15:11:39,256 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. completed. 2023-07-19 15:11:39,257 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:11:39,257 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:11:39,257 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:11:39,257 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,257 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 15:11:39,257 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:11:39,258 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 15:11:39,258 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,258 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:39,259 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 15:11:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:11:39,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 15:11:39,264 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 15:11:39,264 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:11:39,264 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:11:39,264 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,264 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:11:39,279 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,279 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:39,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,279 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,279 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:39,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:39,280 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:39,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:39,280 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:39,280 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,282 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:39,282 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,283 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:39,285 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,286 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,287 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,291 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:39,291 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:39,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:39,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:39,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:39,291 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:39,291 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:39,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:39,292 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:39,292 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:39,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:39,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:39,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:39,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:39,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:39,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:39,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:39,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:39,293 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,293 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,293 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,294 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,294 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:39,294 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,294 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:39,294 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,294 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:39,294 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:39,294 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,294 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,294 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:39,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:11:39,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 15:11:39,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:39,300 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 15:11:39,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719e0e65a8c1da94dcfba958ab54276627b, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719cd7a40cc3af948f3ae2ae7589051d27a] mob files 2023-07-19 15:11:39,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719e0e65a8c1da94dcfba958ab54276627b 2023-07-19 15:11:39,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719cd7a40cc3af948f3ae2ae7589051d27a 2023-07-19 15:11:39,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 15:11:39,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,411 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:11:39,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689779498988Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689779499321 (+333 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689779499321Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689779499321Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689779499333 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689779499348 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689779499410 (+62 ms) 2023-07-19 15:11:39,414 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 15:11:39,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 424 msec 2023-07-19 15:11:39,600 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:39,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 15:11:39,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:11:39,643 DEBUG [Listener at jenkins-hbase4.apache.org/37699] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 15:11:39,647 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 15:11:39,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37001] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 15:11:39,650 DEBUG [Listener at jenkins-hbase4.apache.org/37699] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 15:11:39,655 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 15:11:39,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43149] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 15:11:39,661 DEBUG [Listener at jenkins-hbase4.apache.org/37699] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 15:11:39,664 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 15:11:39,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44923] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 15:11:39,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 15:11:39,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:39,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 15:11:39,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 15:11:39,676 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 15:11:39,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 15:11:39,678 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74 2023-07-19 15:11:39,683 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74 empty. 2023-07-19 15:11:39,684 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:39,684 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74 2023-07-19 15:11:39,684 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29 empty. 2023-07-19 15:11:39,685 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:39,685 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 15:11:39,703 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 15:11:39,705 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5f3dad60ad0185ece8257227f491ac29, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:11:39,705 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d70828302794a817dafc051774103f74, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:11:39,745 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:39,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 5f3dad60ad0185ece8257227f491ac29, disabling compactions & flushes 2023-07-19 15:11:39,746 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:39,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:39,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. after waiting 0 ms 2023-07-19 15:11:39,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:39,746 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:39,746 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 5f3dad60ad0185ece8257227f491ac29: 2023-07-19 15:11:39,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 15:11:39,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 15:11:40,145 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:40,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d70828302794a817dafc051774103f74, disabling compactions & flushes 2023-07-19 15:11:40,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:40,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:40,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. after waiting 0 ms 2023-07-19 15:11:40,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:40,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:40,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d70828302794a817dafc051774103f74: 2023-07-19 15:11:40,154 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 15:11:40,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779500156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779500156"}]},"ts":"1689779500156"} 2023-07-19 15:11:40,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779500156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779500156"}]},"ts":"1689779500156"} 2023-07-19 15:11:40,159 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 15:11:40,160 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 15:11:40,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779500160"}]},"ts":"1689779500160"} 2023-07-19 15:11:40,162 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 15:11:40,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:11:40,173 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:11:40,173 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:11:40,173 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:11:40,173 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:11:40,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d70828302794a817dafc051774103f74, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f3dad60ad0185ece8257227f491ac29, ASSIGN}] 2023-07-19 15:11:40,180 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f3dad60ad0185ece8257227f491ac29, ASSIGN 2023-07-19 15:11:40,180 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d70828302794a817dafc051774103f74, ASSIGN 2023-07-19 15:11:40,182 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d70828302794a817dafc051774103f74, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44923,1689779417285; forceNewPlan=false, retain=false 2023-07-19 15:11:40,182 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f3dad60ad0185ece8257227f491ac29, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43149,1689779417350; forceNewPlan=false, retain=false 2023-07-19 15:11:40,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 15:11:40,332 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 15:11:40,336 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d70828302794a817dafc051774103f74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:40,336 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5f3dad60ad0185ece8257227f491ac29, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:40,336 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779500336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779500336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779500336"}]},"ts":"1689779500336"} 2023-07-19 15:11:40,336 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779500336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779500336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779500336"}]},"ts":"1689779500336"} 2023-07-19 15:11:40,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure d70828302794a817dafc051774103f74, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:11:40,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 5f3dad60ad0185ece8257227f491ac29, server=jenkins-hbase4.apache.org,43149,1689779417350}] 2023-07-19 15:11:40,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:40,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d70828302794a817dafc051774103f74, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 15:11:40,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. service=AccessControlService 2023-07-19 15:11:40,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:11:40,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d70828302794a817dafc051774103f74 2023-07-19 15:11:40,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:40,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d70828302794a817dafc051774103f74 2023-07-19 15:11:40,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d70828302794a817dafc051774103f74 2023-07-19 15:11:40,515 INFO [StoreOpener-d70828302794a817dafc051774103f74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d70828302794a817dafc051774103f74 2023-07-19 15:11:40,520 DEBUG [StoreOpener-d70828302794a817dafc051774103f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/cf 2023-07-19 15:11:40,520 DEBUG [StoreOpener-d70828302794a817dafc051774103f74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/cf 2023-07-19 15:11:40,523 INFO [StoreOpener-d70828302794a817dafc051774103f74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d70828302794a817dafc051774103f74 columnFamilyName cf 2023-07-19 15:11:40,524 INFO [StoreOpener-d70828302794a817dafc051774103f74-1] regionserver.HStore(310): Store=d70828302794a817dafc051774103f74/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:11:40,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:40,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f3dad60ad0185ece8257227f491ac29, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 15:11:40,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74 2023-07-19 15:11:40,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. service=AccessControlService 2023-07-19 15:11:40,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:11:40,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:40,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74 2023-07-19 15:11:40,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:40,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:40,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:40,528 INFO [StoreOpener-5f3dad60ad0185ece8257227f491ac29-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:40,530 DEBUG [StoreOpener-5f3dad60ad0185ece8257227f491ac29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/cf 2023-07-19 15:11:40,530 DEBUG [StoreOpener-5f3dad60ad0185ece8257227f491ac29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/cf 2023-07-19 15:11:40,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d70828302794a817dafc051774103f74 2023-07-19 15:11:40,531 INFO [StoreOpener-5f3dad60ad0185ece8257227f491ac29-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f3dad60ad0185ece8257227f491ac29 columnFamilyName cf 2023-07-19 15:11:40,531 INFO [StoreOpener-5f3dad60ad0185ece8257227f491ac29-1] regionserver.HStore(310): Store=5f3dad60ad0185ece8257227f491ac29/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:11:40,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:40,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:40,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:40,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:11:40,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d70828302794a817dafc051774103f74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72220259, jitterRate=0.07616572082042694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:11:40,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d70828302794a817dafc051774103f74: 2023-07-19 15:11:40,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74., pid=69, masterSystemTime=1689779500501 2023-07-19 15:11:40,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:11:40,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f3dad60ad0185ece8257227f491ac29; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62374078, jitterRate=-0.07055380940437317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:11:40,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f3dad60ad0185ece8257227f491ac29: 2023-07-19 15:11:40,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29., pid=70, masterSystemTime=1689779500502 2023-07-19 15:11:40,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:40,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:40,551 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d70828302794a817dafc051774103f74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:40,551 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779500551"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779500551"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779500551"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779500551"}]},"ts":"1689779500551"} 2023-07-19 15:11:40,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:40,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:40,552 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5f3dad60ad0185ece8257227f491ac29, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:40,553 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779500552"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779500552"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779500552"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779500552"}]},"ts":"1689779500552"} 2023-07-19 15:11:40,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-19 15:11:40,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure d70828302794a817dafc051774103f74, server=jenkins-hbase4.apache.org,44923,1689779417285 in 207 msec 2023-07-19 15:11:40,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-19 15:11:40,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 5f3dad60ad0185ece8257227f491ac29, server=jenkins-hbase4.apache.org,43149,1689779417350 in 205 msec 2023-07-19 15:11:40,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d70828302794a817dafc051774103f74, ASSIGN in 383 msec 2023-07-19 15:11:40,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-19 15:11:40,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f3dad60ad0185ece8257227f491ac29, ASSIGN in 384 msec 2023-07-19 15:11:40,562 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 15:11:40,562 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779500562"}]},"ts":"1689779500562"} 2023-07-19 15:11:40,569 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 15:11:40,578 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 15:11:40,579 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 15:11:40,581 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 15:11:40,582 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:40,582 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:40,582 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:40,582 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:11:40,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:40,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:40,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:40,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:40,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:40,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:40,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:40,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 15:11:40,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 917 msec 2023-07-19 15:11:40,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 15:11:40,784 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 15:11:40,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions d70828302794a817dafc051774103f74, 5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:40,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d70828302794a817dafc051774103f74, 5f3dad60ad0185ece8257227f491ac29], force=true 2023-07-19 15:11:40,825 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d70828302794a817dafc051774103f74, 5f3dad60ad0185ece8257227f491ac29], force=true 2023-07-19 15:11:40,826 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d70828302794a817dafc051774103f74, 5f3dad60ad0185ece8257227f491ac29], force=true 2023-07-19 15:11:40,826 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d70828302794a817dafc051774103f74, 5f3dad60ad0185ece8257227f491ac29], force=true 2023-07-19 15:11:40,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 15:11:40,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d70828302794a817dafc051774103f74, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f3dad60ad0185ece8257227f491ac29, UNASSIGN}] 2023-07-19 15:11:40,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f3dad60ad0185ece8257227f491ac29, UNASSIGN 2023-07-19 15:11:40,864 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d70828302794a817dafc051774103f74, UNASSIGN 2023-07-19 15:11:40,865 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5f3dad60ad0185ece8257227f491ac29, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:40,865 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779500865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779500865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779500865"}]},"ts":"1689779500865"} 2023-07-19 15:11:40,866 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d70828302794a817dafc051774103f74, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:40,866 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779500866"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779500866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779500866"}]},"ts":"1689779500866"} 2023-07-19 15:11:40,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 5f3dad60ad0185ece8257227f491ac29, server=jenkins-hbase4.apache.org,43149,1689779417350}] 2023-07-19 15:11:40,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure d70828302794a817dafc051774103f74, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:11:40,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 15:11:41,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d70828302794a817dafc051774103f74 2023-07-19 15:11:41,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:41,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d70828302794a817dafc051774103f74, disabling compactions & flushes 2023-07-19 15:11:41,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f3dad60ad0185ece8257227f491ac29, disabling compactions & flushes 2023-07-19 15:11:41,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:41,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. after waiting 0 ms 2023-07-19 15:11:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. after waiting 0 ms 2023-07-19 15:11:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:41,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:41,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d70828302794a817dafc051774103f74 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 15:11:41,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5f3dad60ad0185ece8257227f491ac29 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 15:11:41,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/.tmp/cf/276758929e3147e7b4ba1541416317a0 2023-07-19 15:11:41,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 15:11:41,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/.tmp/cf/5b3ac05275cc4c16baab70d20610a43e 2023-07-19 15:11:41,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/.tmp/cf/276758929e3147e7b4ba1541416317a0 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/cf/276758929e3147e7b4ba1541416317a0 2023-07-19 15:11:41,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/.tmp/cf/5b3ac05275cc4c16baab70d20610a43e as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/cf/5b3ac05275cc4c16baab70d20610a43e 2023-07-19 15:11:41,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/cf/5b3ac05275cc4c16baab70d20610a43e, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 15:11:41,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d70828302794a817dafc051774103f74 in 142ms, sequenceid=5, compaction requested=false 2023-07-19 15:11:41,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 15:11:41,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/cf/276758929e3147e7b4ba1541416317a0, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 15:11:41,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5f3dad60ad0185ece8257227f491ac29 in 149ms, sequenceid=5, compaction requested=false 2023-07-19 15:11:41,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 15:11:41,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:11:41,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74. 2023-07-19 15:11:41,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d70828302794a817dafc051774103f74: 2023-07-19 15:11:41,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 15:11:41,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:11:41,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29. 2023-07-19 15:11:41,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f3dad60ad0185ece8257227f491ac29: 2023-07-19 15:11:41,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d70828302794a817dafc051774103f74 2023-07-19 15:11:41,224 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d70828302794a817dafc051774103f74, regionState=CLOSED 2023-07-19 15:11:41,224 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779501224"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779501224"}]},"ts":"1689779501224"} 2023-07-19 15:11:41,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:11:41,226 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5f3dad60ad0185ece8257227f491ac29, regionState=CLOSED 2023-07-19 15:11:41,227 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689779501226"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779501226"}]},"ts":"1689779501226"} 2023-07-19 15:11:41,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-19 15:11:41,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure d70828302794a817dafc051774103f74, server=jenkins-hbase4.apache.org,44923,1689779417285 in 357 msec 2023-07-19 15:11:41,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-19 15:11:41,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d70828302794a817dafc051774103f74, UNASSIGN in 435 msec 2023-07-19 15:11:41,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 5f3dad60ad0185ece8257227f491ac29, server=jenkins-hbase4.apache.org,43149,1689779417350 in 369 msec 2023-07-19 15:11:41,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-19 15:11:41,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f3dad60ad0185ece8257227f491ac29, UNASSIGN in 434 msec 2023-07-19 15:11:41,306 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0004_000001 (auth:SIMPLE) 2023-07-19 15:11:41,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 15:11:41,439 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 15:11:41,442 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499671.d70828302794a817dafc051774103f74.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 15:11:41,442 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689779499671.5f3dad60ad0185ece8257227f491ac29.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 15:11:41,442 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 15:11:41,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6cde93b5297ee134b4d8ea8a2c72e32, ASSIGN}] 2023-07-19 15:11:41,500 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6cde93b5297ee134b4d8ea8a2c72e32, ASSIGN 2023-07-19 15:11:41,501 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6cde93b5297ee134b4d8ea8a2c72e32, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,44923,1689779417285; forceNewPlan=false, retain=false 2023-07-19 15:11:41,651 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 15:11:41,653 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c6cde93b5297ee134b4d8ea8a2c72e32, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:41,653 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689779501653"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779501653"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779501653"}]},"ts":"1689779501653"} 2023-07-19 15:11:41,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure c6cde93b5297ee134b4d8ea8a2c72e32, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:11:41,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. 2023-07-19 15:11:41,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c6cde93b5297ee134b4d8ea8a2c72e32, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.', STARTKEY => '', ENDKEY => ''} 2023-07-19 15:11:41,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. service=AccessControlService 2023-07-19 15:11:41,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:11:41,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:11:41,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:11:41,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:11:41,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:11:41,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/.regioninfo 2023-07-19 15:11:41,826 INFO [StoreOpener-c6cde93b5297ee134b4d8ea8a2c72e32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:11:41,827 DEBUG [StoreOpener-c6cde93b5297ee134b4d8ea8a2c72e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf 2023-07-19 15:11:41,827 DEBUG [StoreOpener-c6cde93b5297ee134b4d8ea8a2c72e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf 2023-07-19 15:11:41,827 INFO [StoreOpener-c6cde93b5297ee134b4d8ea8a2c72e32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6cde93b5297ee134b4d8ea8a2c72e32 columnFamilyName cf 2023-07-19 15:11:41,855 DEBUG [StoreOpener-c6cde93b5297ee134b4d8ea8a2c72e32-1] regionserver.HStore(539): loaded hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/276758929e3147e7b4ba1541416317a0.5f3dad60ad0185ece8257227f491ac29->hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/cf/276758929e3147e7b4ba1541416317a0-top 2023-07-19 15:11:41,861 DEBUG [StoreOpener-c6cde93b5297ee134b4d8ea8a2c72e32-1] regionserver.HStore(539): loaded hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/5b3ac05275cc4c16baab70d20610a43e.d70828302794a817dafc051774103f74->hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/cf/5b3ac05275cc4c16baab70d20610a43e-top 2023-07-19 15:11:41,861 INFO [StoreOpener-c6cde93b5297ee134b4d8ea8a2c72e32-1] regionserver.HStore(310): Store=c6cde93b5297ee134b4d8ea8a2c72e32/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:11:41,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:11:41,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:11:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:11:41,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c6cde93b5297ee134b4d8ea8a2c72e32; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65381927, jitterRate=-0.02573336660861969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:11:41,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c6cde93b5297ee134b4d8ea8a2c72e32: 2023-07-19 15:11:41,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32., pid=77, masterSystemTime=1689779501807 2023-07-19 15:11:41,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.,because compaction is disabled. 2023-07-19 15:11:41,883 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c6cde93b5297ee134b4d8ea8a2c72e32, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:41,883 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689779501883"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779501883"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779501883"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779501883"}]},"ts":"1689779501883"} 2023-07-19 15:11:41,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 15:11:41,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure c6cde93b5297ee134b4d8ea8a2c72e32, server=jenkins-hbase4.apache.org,44923,1689779417285 in 230 msec 2023-07-19 15:11:41,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. 2023-07-19 15:11:41,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. 2023-07-19 15:11:41,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 15:11:41,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6cde93b5297ee134b4d8ea8a2c72e32, ASSIGN in 389 msec 2023-07-19 15:11:41,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d70828302794a817dafc051774103f74, 5f3dad60ad0185ece8257227f491ac29], force=true in 1.0770 sec 2023-07-19 15:11:41,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 15:11:41,936 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 15:11:41,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 15:11:41,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779501937 (current time:1689779501937). 2023-07-19 15:11:41,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:11:41,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x09394939 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:41,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1635d85b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:41,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:41,996 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:41,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09394939 to 127.0.0.1:52285 2023-07-19 15:11:41,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:41,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x4b4ee640 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:11:42,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8fd1e91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:11:42,069 DEBUG [hconnection-0x30b2f8d5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:42,073 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:42,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:11:42,080 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:11:42,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b4ee640 to 127.0.0.1:52285 2023-07-19 15:11:42,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:11:42,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 15:11:42,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:11:42,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 15:11:42,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 15:11:42,085 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 15:11:42,086 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689780102086 2023-07-19 15:11:42,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 15:11:42,086 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,091 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:11:42,091 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:11:42,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 15:11:42,092 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 15:11:42,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-19 15:11:42,094 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 15:11:42,095 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689780102095 2023-07-19 15:11:42,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,189 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 15:11:42,189 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:42,191 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 15:11:42,191 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 15:11:42,191 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:42,192 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,192 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 15:11:42,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:42,192 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:11:42,218 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:42,218 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:42,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:42,218 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,218 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:42,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:42,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:42,218 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,219 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:11:42,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,220 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 15:11:42,220 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 15:11:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 15:11:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 15:11:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 15:11:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 15:11:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:11:42,224 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 15:11:42,224 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 15:11:42,225 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 15:11:42,225 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 15:11:42,225 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 15:11:42,225 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 15:11:42,287 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,296 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,306 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 15:11:42,350 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,350 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:42,354 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,355 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:11:42,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:42,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:42,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:42,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 15:11:42,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ad05434[Count = 0] remaining members to acquire global barrier 2023-07-19 15:11:42,357 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 15:11:42,357 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,394 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:42,395 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,395 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,395 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,395 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 15:11:42,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,396 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 15:11:42,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 15:11:42,395 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 15:11:42,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:42,396 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 15:11:42,396 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 15:11:42,396 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:11:42,396 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:11:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 15:11:42,399 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:11:42,399 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. 2023-07-19 15:11:42,399 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:11:42,400 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. started... 2023-07-19 15:11:42,402 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c6cde93b5297ee134b4d8ea8a2c72e32: 2023-07-19 15:11:42,403 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,403 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:11:42,403 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/276758929e3147e7b4ba1541416317a0.5f3dad60ad0185ece8257227f491ac29->hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/cf/276758929e3147e7b4ba1541416317a0-top, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/5b3ac05275cc4c16baab70d20610a43e.d70828302794a817dafc051774103f74->hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/cf/5b3ac05275cc4c16baab70d20610a43e-top] hfiles 2023-07-19 15:11:42,403 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/276758929e3147e7b4ba1541416317a0.5f3dad60ad0185ece8257227f491ac29 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,407 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/5b3ac05275cc4c16baab70d20610a43e.d70828302794a817dafc051774103f74 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,449 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 15:11:42,449 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,449 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:11:42,449 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:42,449 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 15:11:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 15:11:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:42,452 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 15:11:42,590 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. completed. 2023-07-19 15:11:42,590 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. 2023-07-19 15:11:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:11:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:11:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 15:11:42,591 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:11:42,645 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,645 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 15:11:42,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:42,645 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:42,646 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 15:11:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:42,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:42,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:42,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:42,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:42,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:11:42,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 15:11:42,654 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 15:11:42,654 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:11:42,654 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:11:42,655 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,655 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:11:42,658 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:42,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:42,658 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:11:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:11:42,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:42,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:11:42,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,662 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,663 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:42,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:11:42,664 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:42,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:42,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:42,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:11:42,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,667 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,667 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:42,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:42,668 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:42,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:42,687 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:42,687 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:42,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:42,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,688 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:42,688 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:42,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:42,688 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:11:42,689 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:11:42,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:42,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:42,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:11:42,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:11:42,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:42,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:42,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:11:42,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:11:42,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:42,696 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:42,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 15:11:42,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:11:42,698 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 15:11:43,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:43,189 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 15:11:43,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:43,190 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:43,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689779502086Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689779502688 (+602 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689779502690 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689779502695 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689779503140 (+445 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689779503189 (+49 ms) 2023-07-19 15:11:43,204 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 15:11:43,205 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:11:43,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 15:11:43,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:11:43,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 1.1130 sec 2023-07-19 15:11:43,206 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206 2023-07-19 15:11:43,206 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44363, tgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206, rawTgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206, srcFsUri=hdfs://localhost:44363, srcDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:11:43,234 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:11:43,234 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-245141524_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:43,234 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983, snapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 15:11:43,246 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:11:43,303 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:43,303 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:43,304 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:43,304 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:44,428 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-1738723535453716619.jar 2023-07-19 15:11:44,429 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:44,429 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:44,529 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-492589931666993015.jar 2023-07-19 15:11:44,529 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:44,530 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:44,531 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:44,531 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:44,532 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:44,532 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 15:11:44,533 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 15:11:44,534 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 15:11:44,534 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 15:11:44,535 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 15:11:44,535 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 15:11:44,536 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 15:11:44,537 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 15:11:44,537 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 15:11:44,538 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 15:11:44,539 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 15:11:44,539 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:44,540 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:44,541 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:11:44,541 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:44,542 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:11:44,543 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:11:44,543 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:11:45,919 WARN [Listener at jenkins-hbase4.apache.org/37699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 15:11:45,922 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 15:11:45,924 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 15:11:46,500 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:11:46,500 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:11:47,040 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0005_000001 (auth:SIMPLE) 2023-07-19 15:11:47,316 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 15:11:53,214 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0005_000001 (auth:SIMPLE) 2023-07-19 15:11:55,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0005_000001 (auth:SIMPLE) 2023-07-19 15:11:59,676 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0005_000001 (auth:SIMPLE) 2023-07-19 15:12:01,686 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 15:12:01,690 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 15:12:01,700 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:01,700 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 15:12:01,701 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 15:12:01,701 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:01,702 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 15:12:01,702 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 15:12:01,702 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:01,702 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 15:12:01,703 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779503206/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 15:12:01,710 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:01,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:01,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:01,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 15:12:01,715 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779521715"}]},"ts":"1689779521715"} 2023-07-19 15:12:01,717 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 15:12:01,719 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 15:12:01,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6cde93b5297ee134b4d8ea8a2c72e32, UNASSIGN}] 2023-07-19 15:12:01,730 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6cde93b5297ee134b4d8ea8a2c72e32, UNASSIGN 2023-07-19 15:12:01,731 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c6cde93b5297ee134b4d8ea8a2c72e32, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:01,732 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689779521731"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779521731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779521731"}]},"ts":"1689779521731"} 2023-07-19 15:12:01,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure c6cde93b5297ee134b4d8ea8a2c72e32, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:12:01,807 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,44923,1689779417285, timeout=1689779521885, delay=78, operations=[pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure c6cde93b5297ee134b4d8ea8a2c72e32, server=jenkins-hbase4.apache.org,44923,1689779417285]] 2023-07-19 15:12:01,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 15:12:01,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:12:01,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c6cde93b5297ee134b4d8ea8a2c72e32, disabling compactions & flushes 2023-07-19 15:12:01,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. 2023-07-19 15:12:01,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. 2023-07-19 15:12:01,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. after waiting 0 ms 2023-07-19 15:12:01,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. 2023-07-19 15:12:01,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 15:12:01,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:12:01,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32. 2023-07-19 15:12:01,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c6cde93b5297ee134b4d8ea8a2c72e32: 2023-07-19 15:12:01,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:12:01,912 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c6cde93b5297ee134b4d8ea8a2c72e32, regionState=CLOSED 2023-07-19 15:12:01,913 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689779521912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779521912"}]},"ts":"1689779521912"} 2023-07-19 15:12:01,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 15:12:01,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure c6cde93b5297ee134b4d8ea8a2c72e32, server=jenkins-hbase4.apache.org,44923,1689779417285 in 192 msec 2023-07-19 15:12:01,939 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 15:12:01,939 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c6cde93b5297ee134b4d8ea8a2c72e32, UNASSIGN in 206 msec 2023-07-19 15:12:01,939 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779521939"}]},"ts":"1689779521939"} 2023-07-19 15:12:01,941 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 15:12:01,943 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 15:12:01,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 233 msec 2023-07-19 15:12:02,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 15:12:02,018 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 15:12:02,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,027 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,028 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,029 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,032 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,032 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,032 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,032 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 15:12:02,033 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:12:02,035 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,035 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:02,035 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:02,035 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 15:12:02,035 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 15:12:02,036 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 15:12:02,036 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,036 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:02,036 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:02,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 15:12:02,036 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 15:12:02,037 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:02,037 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:02,037 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:02,037 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:02,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 15:12:02,042 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/recovered.edits] 2023-07-19 15:12:02,043 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74 2023-07-19 15:12:02,042 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:12:02,050 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/recovered.edits] 2023-07-19 15:12:02,056 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/cf/276758929e3147e7b4ba1541416317a0 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/cf/276758929e3147e7b4ba1541416317a0 2023-07-19 15:12:02,060 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/recovered.edits/8.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29/recovered.edits/8.seqid 2023-07-19 15:12:02,061 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:12:02,064 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/recovered.edits] 2023-07-19 15:12:02,070 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/cf/5b3ac05275cc4c16baab70d20610a43e to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/cf/5b3ac05275cc4c16baab70d20610a43e 2023-07-19 15:12:02,076 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/recovered.edits/8.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74/recovered.edits/8.seqid 2023-07-19 15:12:02,077 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d70828302794a817dafc051774103f74 2023-07-19 15:12:02,078 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/276758929e3147e7b4ba1541416317a0.5f3dad60ad0185ece8257227f491ac29 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/276758929e3147e7b4ba1541416317a0.5f3dad60ad0185ece8257227f491ac29 2023-07-19 15:12:02,080 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/5b3ac05275cc4c16baab70d20610a43e.d70828302794a817dafc051774103f74 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/cf/5b3ac05275cc4c16baab70d20610a43e.d70828302794a817dafc051774103f74 2023-07-19 15:12:02,083 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/recovered.edits/12.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32/recovered.edits/12.seqid 2023-07-19 15:12:02,084 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c6cde93b5297ee134b4d8ea8a2c72e32 2023-07-19 15:12:02,084 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 15:12:02,088 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,100 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 15:12:02,108 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 15:12:02,110 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,110 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 15:12:02,110 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779522110"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:02,112 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 15:12:02,112 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c6cde93b5297ee134b4d8ea8a2c72e32, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689779499672.c6cde93b5297ee134b4d8ea8a2c72e32.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 15:12:02,112 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 15:12:02,112 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689779522112"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:02,114 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 15:12:02,118 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 100 msec 2023-07-19 15:12:02,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 15:12:02,139 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 15:12:02,140 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 15:12:02,145 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779522145"}]},"ts":"1689779522145"} 2023-07-19 15:12:02,147 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 15:12:02,148 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 15:12:02,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=047fbe9aba6d078d025a86d2dc7af2f8, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f535968f3531c233fb85981e7ff50e11, UNASSIGN}] 2023-07-19 15:12:02,152 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=047fbe9aba6d078d025a86d2dc7af2f8, UNASSIGN 2023-07-19 15:12:02,152 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f535968f3531c233fb85981e7ff50e11, UNASSIGN 2023-07-19 15:12:02,153 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=047fbe9aba6d078d025a86d2dc7af2f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:02,153 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f535968f3531c233fb85981e7ff50e11, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:02,153 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779522153"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779522153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779522153"}]},"ts":"1689779522153"} 2023-07-19 15:12:02,153 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779522153"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779522153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779522153"}]},"ts":"1689779522153"} 2023-07-19 15:12:02,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 047fbe9aba6d078d025a86d2dc7af2f8, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:12:02,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure f535968f3531c233fb85981e7ff50e11, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:12:02,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 15:12:02,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:12:02,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 047fbe9aba6d078d025a86d2dc7af2f8, disabling compactions & flushes 2023-07-19 15:12:02,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:12:02,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:12:02,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. after waiting 0 ms 2023-07-19 15:12:02,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:12:02,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f535968f3531c233fb85981e7ff50e11 2023-07-19 15:12:02,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f535968f3531c233fb85981e7ff50e11, disabling compactions & flushes 2023-07-19 15:12:02,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:12:02,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:12:02,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. after waiting 0 ms 2023-07-19 15:12:02,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:12:02,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:12:02,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:12:02,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8. 2023-07-19 15:12:02,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 047fbe9aba6d078d025a86d2dc7af2f8: 2023-07-19 15:12:02,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:12:02,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:12:02,354 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=047fbe9aba6d078d025a86d2dc7af2f8, regionState=CLOSED 2023-07-19 15:12:02,354 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779522354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779522354"}]},"ts":"1689779522354"} 2023-07-19 15:12:02,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:12:02,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11. 2023-07-19 15:12:02,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f535968f3531c233fb85981e7ff50e11: 2023-07-19 15:12:02,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f535968f3531c233fb85981e7ff50e11 2023-07-19 15:12:02,358 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f535968f3531c233fb85981e7ff50e11, regionState=CLOSED 2023-07-19 15:12:02,358 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689779522358"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779522358"}]},"ts":"1689779522358"} 2023-07-19 15:12:02,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-19 15:12:02,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 047fbe9aba6d078d025a86d2dc7af2f8, server=jenkins-hbase4.apache.org,44923,1689779417285 in 200 msec 2023-07-19 15:12:02,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-19 15:12:02,363 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=047fbe9aba6d078d025a86d2dc7af2f8, UNASSIGN in 211 msec 2023-07-19 15:12:02,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure f535968f3531c233fb85981e7ff50e11, server=jenkins-hbase4.apache.org,37001,1689779417218 in 198 msec 2023-07-19 15:12:02,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-19 15:12:02,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f535968f3531c233fb85981e7ff50e11, UNASSIGN in 214 msec 2023-07-19 15:12:02,373 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779522373"}]},"ts":"1689779522373"} 2023-07-19 15:12:02,374 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 15:12:02,376 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 15:12:02,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 237 msec 2023-07-19 15:12:02,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 15:12:02,447 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 15:12:02,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,452 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,454 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,455 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,458 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,458 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,458 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,459 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 15:12:02,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 15:12:02,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 15:12:02,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 15:12:02,460 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,461 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:02,461 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,461 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:02,461 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,461 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:02,462 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,462 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:02,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 15:12:02,470 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:12:02,470 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11 2023-07-19 15:12:02,475 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/recovered.edits] 2023-07-19 15:12:02,476 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/recovered.edits] 2023-07-19 15:12:02,482 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/cf/99669d001ee742988ffd2d6905ba1c39 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/cf/99669d001ee742988ffd2d6905ba1c39 2023-07-19 15:12:02,483 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/cf/4a3fd3c9d9dd4ce38cd9419521322535 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/cf/4a3fd3c9d9dd4ce38cd9419521322535 2023-07-19 15:12:02,487 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8/recovered.edits/9.seqid 2023-07-19 15:12:02,489 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/047fbe9aba6d078d025a86d2dc7af2f8 2023-07-19 15:12:02,489 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11/recovered.edits/9.seqid 2023-07-19 15:12:02,489 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f535968f3531c233fb85981e7ff50e11 2023-07-19 15:12:02,489 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 15:12:02,490 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 15:12:02,491 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-19 15:12:02,497 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719e0e65a8c1da94dcfba958ab54276627b to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719e0e65a8c1da94dcfba958ab54276627b 2023-07-19 15:12:02,499 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719cd7a40cc3af948f3ae2ae7589051d27a to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719cd7a40cc3af948f3ae2ae7589051d27a 2023-07-19 15:12:02,500 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 15:12:02,502 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,505 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 15:12:02,515 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 15:12:02,517 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,517 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 15:12:02,517 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779522517"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:02,517 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779522517"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:02,519 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 15:12:02,519 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 047fbe9aba6d078d025a86d2dc7af2f8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689779497053.047fbe9aba6d078d025a86d2dc7af2f8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f535968f3531c233fb85981e7ff50e11, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689779497053.f535968f3531c233fb85981e7ff50e11.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 15:12:02,519 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 15:12:02,519 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689779522519"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:02,521 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 15:12:02,524 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 75 msec 2023-07-19 15:12:02,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 15:12:02,564 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 15:12:02,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 15:12:02,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 15:12:02,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 15:12:02,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 15:12:02,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 15:12:02,626 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2131657169_1 at /127.0.0.1:35472 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:40778 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2131657169_1 at /127.0.0.1:55496 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:36133 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:41362 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4228 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:53690 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=509 (was 375) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 183), AvailableMemoryMB=2917 (was 3498) 2023-07-19 15:12:02,627 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-19 15:12:02,680 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=509, ProcessCount=180, AvailableMemoryMB=2897 2023-07-19 15:12:02,680 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-19 15:12:02,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 15:12:02,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 15:12:02,687 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 15:12:02,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 15:12:02,688 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 15:12:02,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 15:12:02,695 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:02,695 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:02,696 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b empty. 2023-07-19 15:12:02,696 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf empty. 2023-07-19 15:12:02,696 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:02,697 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:02,697 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 15:12:02,720 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 15:12:02,721 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 867e2cc5fabcd9e83facdf880b88b94b, NAME => 'testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:12:02,727 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9ab101e7341f358bf2573430cead7cdf, NAME => 'testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:12:02,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:12:02,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9ab101e7341f358bf2573430cead7cdf, disabling compactions & flushes 2023-07-19 15:12:02,754 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:02,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:02,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. after waiting 0 ms 2023-07-19 15:12:02,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:02,754 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:02,754 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9ab101e7341f358bf2573430cead7cdf: 2023-07-19 15:12:02,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 15:12:02,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 15:12:03,155 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:12:03,155 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 867e2cc5fabcd9e83facdf880b88b94b, disabling compactions & flushes 2023-07-19 15:12:03,155 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,155 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,155 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. after waiting 0 ms 2023-07-19 15:12:03,155 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,155 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,155 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 867e2cc5fabcd9e83facdf880b88b94b: 2023-07-19 15:12:03,159 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 15:12:03,160 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779523160"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779523160"}]},"ts":"1689779523160"} 2023-07-19 15:12:03,160 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779523160"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779523160"}]},"ts":"1689779523160"} 2023-07-19 15:12:03,162 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 15:12:03,163 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 15:12:03,163 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779523163"}]},"ts":"1689779523163"} 2023-07-19 15:12:03,164 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 15:12:03,168 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:12:03,170 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:12:03,170 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:12:03,170 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:12:03,170 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:12:03,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=867e2cc5fabcd9e83facdf880b88b94b, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ab101e7341f358bf2573430cead7cdf, ASSIGN}] 2023-07-19 15:12:03,173 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=867e2cc5fabcd9e83facdf880b88b94b, ASSIGN 2023-07-19 15:12:03,175 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=867e2cc5fabcd9e83facdf880b88b94b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37001,1689779417218; forceNewPlan=false, retain=false 2023-07-19 15:12:03,178 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ab101e7341f358bf2573430cead7cdf, ASSIGN 2023-07-19 15:12:03,181 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ab101e7341f358bf2573430cead7cdf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44923,1689779417285; forceNewPlan=false, retain=false 2023-07-19 15:12:03,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 15:12:03,330 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 15:12:03,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=867e2cc5fabcd9e83facdf880b88b94b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,333 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9ab101e7341f358bf2573430cead7cdf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,334 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779523333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779523333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779523333"}]},"ts":"1689779523333"} 2023-07-19 15:12:03,334 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779523333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779523333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779523333"}]},"ts":"1689779523333"} 2023-07-19 15:12:03,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 867e2cc5fabcd9e83facdf880b88b94b, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:12:03,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 9ab101e7341f358bf2573430cead7cdf, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:12:03,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 867e2cc5fabcd9e83facdf880b88b94b, NAME => 'testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 15:12:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. service=AccessControlService 2023-07-19 15:12:03,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:12:03,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ab101e7341f358bf2573430cead7cdf, NAME => 'testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 15:12:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:12:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. service=AccessControlService 2023-07-19 15:12:03,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:12:03,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:03,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:12:03,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:03,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:03,495 INFO [StoreOpener-867e2cc5fabcd9e83facdf880b88b94b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:03,495 INFO [StoreOpener-9ab101e7341f358bf2573430cead7cdf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:03,496 DEBUG [StoreOpener-867e2cc5fabcd9e83facdf880b88b94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/cf 2023-07-19 15:12:03,496 DEBUG [StoreOpener-867e2cc5fabcd9e83facdf880b88b94b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/cf 2023-07-19 15:12:03,497 DEBUG [StoreOpener-9ab101e7341f358bf2573430cead7cdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/cf 2023-07-19 15:12:03,497 DEBUG [StoreOpener-9ab101e7341f358bf2573430cead7cdf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/cf 2023-07-19 15:12:03,497 INFO [StoreOpener-867e2cc5fabcd9e83facdf880b88b94b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 867e2cc5fabcd9e83facdf880b88b94b columnFamilyName cf 2023-07-19 15:12:03,497 INFO [StoreOpener-9ab101e7341f358bf2573430cead7cdf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ab101e7341f358bf2573430cead7cdf columnFamilyName cf 2023-07-19 15:12:03,498 INFO [StoreOpener-867e2cc5fabcd9e83facdf880b88b94b-1] regionserver.HStore(310): Store=867e2cc5fabcd9e83facdf880b88b94b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:12:03,498 INFO [StoreOpener-9ab101e7341f358bf2573430cead7cdf-1] regionserver.HStore(310): Store=9ab101e7341f358bf2573430cead7cdf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:12:03,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:03,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:03,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:03,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:03,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:03,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:03,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:12:03,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 867e2cc5fabcd9e83facdf880b88b94b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75163118, jitterRate=0.12001773715019226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:12:03,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 867e2cc5fabcd9e83facdf880b88b94b: 2023-07-19 15:12:03,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:12:03,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b., pid=93, masterSystemTime=1689779523489 2023-07-19 15:12:03,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9ab101e7341f358bf2573430cead7cdf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63666143, jitterRate=-0.0513005405664444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:12:03,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9ab101e7341f358bf2573430cead7cdf: 2023-07-19 15:12:03,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf., pid=94, masterSystemTime=1689779523490 2023-07-19 15:12:03,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,515 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=867e2cc5fabcd9e83facdf880b88b94b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,515 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779523515"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779523515"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779523515"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779523515"}]},"ts":"1689779523515"} 2023-07-19 15:12:03,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:03,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:03,516 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9ab101e7341f358bf2573430cead7cdf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,517 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779523516"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779523516"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779523516"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779523516"}]},"ts":"1689779523516"} 2023-07-19 15:12:03,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 15:12:03,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 867e2cc5fabcd9e83facdf880b88b94b, server=jenkins-hbase4.apache.org,37001,1689779417218 in 183 msec 2023-07-19 15:12:03,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 15:12:03,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 9ab101e7341f358bf2573430cead7cdf, server=jenkins-hbase4.apache.org,44923,1689779417285 in 181 msec 2023-07-19 15:12:03,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=867e2cc5fabcd9e83facdf880b88b94b, ASSIGN in 350 msec 2023-07-19 15:12:03,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-19 15:12:03,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ab101e7341f358bf2573430cead7cdf, ASSIGN in 351 msec 2023-07-19 15:12:03,527 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 15:12:03,527 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779523527"}]},"ts":"1689779523527"} 2023-07-19 15:12:03,529 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 15:12:03,533 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 15:12:03,533 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 15:12:03,535 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 15:12:03,537 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:03,537 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:03,537 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:03,537 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:03,539 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:03,539 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:03,539 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:03,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 857 msec 2023-07-19 15:12:03,542 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:03,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 15:12:03,794 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 15:12:03,796 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 15:12:03,796 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,798 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:12:03,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:12:03,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779523811 (current time:1689779523811). 2023-07-19 15:12:03,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:12:03,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x58799e71 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:12:03,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@276e5b86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:12:03,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:03,828 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:03,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58799e71 to 127.0.0.1:52285 2023-07-19 15:12:03,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:12:03,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x2377be1f to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:12:03,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37692616, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:12:03,839 DEBUG [hconnection-0x620ee916-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:03,842 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:03,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:03,849 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:03,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2377be1f to 127.0.0.1:52285 2023-07-19 15:12:03,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:12:03,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 15:12:03,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:12:03,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:12:03,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:12:03,854 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:12:03,855 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689780123855 2023-07-19 15:12:03,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:12:03,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 15:12:03,856 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:12:03,856 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:12:03,857 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:12:03,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 15:12:03,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-19 15:12:03,862 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 15:12:03,864 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689780123864 2023-07-19 15:12:03,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,876 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 15:12:03,876 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:03,877 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 15:12:03,877 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 15:12:03,878 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,878 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,884 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:03,884 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:03,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:03,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:03,884 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:03,884 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:03,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:03,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:03,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:03,885 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,885 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,885 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,885 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:12:03,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 15:12:03,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,886 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 15:12:03,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,887 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 15:12:03,887 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:03,888 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 15:12:03,888 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 15:12:03,888 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 15:12:03,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 15:12:03,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,891 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 15:12:03,891 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,891 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:03,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:03,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 15:12:03,894 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,894 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:03,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 15:12:03,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:03,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,899 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 15:12:03,899 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:03,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:03,900 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 15:12:03,900 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 15:12:03,901 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:03,900 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 15:12:03,902 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 15:12:03,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,902 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 15:12:03,902 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 15:12:03,902 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 15:12:03,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,904 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,904 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:03,905 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,905 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,906 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:03,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 15:12:03,906 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,906 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:03,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5509f7ac[Count = 1] remaining members to acquire global barrier 2023-07-19 15:12:03,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:03,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:03,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:03,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:03,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:03,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 15:12:03,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5509f7ac[Count = 0] remaining members to acquire global barrier 2023-07-19 15:12:03,909 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 15:12:03,909 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,910 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,910 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,910 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,910 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:12:03,910 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:12:03,910 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,911 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,911 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:12:03,911 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:12:03,910 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 15:12:03,911 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. started... 2023-07-19 15:12:03,911 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:12:03,911 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:12:03,911 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,911 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 867e2cc5fabcd9e83facdf880b88b94b: 2023-07-19 15:12:03,911 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:12:03,911 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:12:03,911 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:12:03,911 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,911 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:03,911 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:12:03,911 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. started... 2023-07-19 15:12:03,911 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:12:03,913 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9ab101e7341f358bf2573430cead7cdf: 2023-07-19 15:12:03,913 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 15:12:03,913 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,913 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:03,913 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:12:03,913 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 15:12:03,913 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:12:03,939 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. completed. 2023-07-19 15:12:03,939 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:03,939 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:12:03,939 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:12:03,939 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,939 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 15:12:03,939 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:12:03,941 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. completed. 2023-07-19 15:12:03,941 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:03,941 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 15:12:03,941 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:12:03,941 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:12:03,941 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:03,941 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,941 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 15:12:03,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:03,941 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,943 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 15:12:03,943 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:12:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:03,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:03,945 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 15:12:03,945 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,945 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:03,945 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 15:12:03,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:03,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:12:03,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 15:12:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:12:03,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 15:12:03,954 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 15:12:03,954 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:12:03,954 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:12:03,954 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,954 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:12:03,955 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,956 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,955 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,956 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:03,956 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:03,956 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:03,956 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:03,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,956 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:03,956 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:03,957 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:03,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:03,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 15:12:03,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:03,958 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:12:03,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:03,959 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:12:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,960 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:03,961 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,961 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:03,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:03,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:03,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,964 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:03,966 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:03,966 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:03,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:03,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:03,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 15:12:03,964 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:03,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:03,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,966 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:03,967 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:03,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:03,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:03,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:12:03,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:03,967 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:03,967 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,967 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:03,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:03,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 15:12:03,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:03,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,019 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 15:12:04,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,020 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689779523855Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689779523976 (+121 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689779523976Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689779523976Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689779523981 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689779523990 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689779524019 (+29 ms) 2023-07-19 15:12:04,024 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 15:12:04,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 168 msec 2023-07-19 15:12:04,159 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:04,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 15:12:04,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:12:04,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37001] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:12:04,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44923] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:12:04,168 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 15:12:04,168 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:04,169 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:12:04,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:12:04,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779524179 (current time:1689779524179). 2023-07-19 15:12:04,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:12:04,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x00f5650b to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:12:04,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15a66a5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:12:04,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:04,191 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:04,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00f5650b to 127.0.0.1:52285 2023-07-19 15:12:04,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:12:04,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x4505d331 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:12:04,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ef32ba7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:12:04,203 DEBUG [hconnection-0x48a17899-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:04,204 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:04,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:04,208 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:04,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4505d331 to 127.0.0.1:52285 2023-07-19 15:12:04,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:12:04,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 15:12:04,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:12:04,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:12:04,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:12:04,213 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:12:04,214 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689780124214 2023-07-19 15:12:04,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 15:12:04,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 15:12:04,215 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:12:04,215 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:12:04,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 15:12:04,218 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 15:12:04,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-19 15:12:04,221 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 15:12:04,223 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689780124223 2023-07-19 15:12:04,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,237 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 15:12:04,237 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:04,238 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 15:12:04,238 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 15:12:04,239 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,239 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,240 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:04,240 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:04,240 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:04,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:04,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:04,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:04,240 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:04,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:04,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:04,241 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,241 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 15:12:04,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,242 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,242 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 15:12:04,242 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:12:04,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 15:12:04,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,243 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 15:12:04,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,243 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 15:12:04,243 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 15:12:04,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 15:12:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 15:12:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 15:12:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 15:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 15:12:04,250 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 15:12:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 15:12:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 15:12:04,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,251 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 15:12:04,251 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:04,254 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 15:12:04,254 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 15:12:04,254 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 15:12:04,254 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,254 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:04,254 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,255 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,255 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:04,256 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:04,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,257 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,257 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:04,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53f6da6d[Count = 1] remaining members to acquire global barrier 2023-07-19 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:04,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 15:12:04,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53f6da6d[Count = 0] remaining members to acquire global barrier 2023-07-19 15:12:04,261 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 15:12:04,261 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,267 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,267 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,267 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:12:04,267 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:12:04,267 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 15:12:04,267 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:12:04,267 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:12:04,267 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:12:04,267 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:04,267 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. started... 2023-07-19 15:12:04,267 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 867e2cc5fabcd9e83facdf880b88b94b 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 15:12:04,269 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,269 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 15:12:04,269 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 15:12:04,270 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:04,270 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 15:12:04,270 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,271 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,271 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:12:04,272 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:12:04,273 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:12:04,273 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:04,273 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. started... 2023-07-19 15:12:04,273 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9ab101e7341f358bf2573430cead7cdf 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 15:12:04,305 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719b91b11f8d5a648c8bdb7eaf5bf9c8138 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719b91b11f8d5a648c8bdb7eaf5bf9c8138 2023-07-19 15:12:04,316 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:04,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 15:12:04,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:12:04,317 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:12:04,318 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719f170131463db4f7980c4ed2d93d4f91f to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719f170131463db4f7980c4ed2d93d4f91f 2023-07-19 15:12:04,327 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/.tmp/cf/bd06b3f36aac46998b18661f6dcd8111 2023-07-19 15:12:04,331 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/.tmp/cf/bd06b3f36aac46998b18661f6dcd8111 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/cf/bd06b3f36aac46998b18661f6dcd8111 2023-07-19 15:12:04,335 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/cf/bd06b3f36aac46998b18661f6dcd8111, entries=4, sequenceid=6, filesize=5.6 K 2023-07-19 15:12:04,336 INFO [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 867e2cc5fabcd9e83facdf880b88b94b in 69ms, sequenceid=6, compaction requested=false 2023-07-19 15:12:04,336 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 15:12:04,337 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 867e2cc5fabcd9e83facdf880b88b94b: 2023-07-19 15:12:04,337 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,337 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:12:04,337 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/cf/bd06b3f36aac46998b18661f6dcd8111] hfiles 2023-07-19 15:12:04,337 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/cf/bd06b3f36aac46998b18661f6dcd8111 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,345 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/.tmp/cf/401dcd925ae045198eb2515ba91721e3 2023-07-19 15:12:04,353 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/.tmp/cf/401dcd925ae045198eb2515ba91721e3 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/cf/401dcd925ae045198eb2515ba91721e3 2023-07-19 15:12:04,359 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/cf/401dcd925ae045198eb2515ba91721e3, entries=46, sequenceid=6, filesize=12.9 K 2023-07-19 15:12:04,360 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9ab101e7341f358bf2573430cead7cdf in 87ms, sequenceid=6, compaction requested=false 2023-07-19 15:12:04,372 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9ab101e7341f358bf2573430cead7cdf: 2023-07-19 15:12:04,372 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,374 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:12:04,374 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/cf/401dcd925ae045198eb2515ba91721e3] hfiles 2023-07-19 15:12:04,374 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/cf/401dcd925ae045198eb2515ba91721e3 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,379 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. completed. 2023-07-19 15:12:04,379 DEBUG [rs(jenkins-hbase4.apache.org,37001,1689779417218)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:04,379 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:12:04,379 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:12:04,379 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,379 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 15:12:04,379 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:12:04,381 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 15:12:04,381 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,381 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,381 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 15:12:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:04,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:04,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37001,1689779417218': 2023-07-19 15:12:04,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 15:12:04,398 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. completed. 2023-07-19 15:12:04,398 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:12:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:12:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 15:12:04,398 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:12:04,401 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 15:12:04,401 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,401 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:04,402 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 15:12:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:12:04,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 15:12:04,407 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 15:12:04,407 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:12:04,407 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:12:04,407 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,407 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:12:04,410 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:04,410 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,410 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:04,411 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:04,411 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:04,412 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:04,413 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,414 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,414 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,418 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,418 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:04,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:04,419 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:04,419 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:04,419 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,421 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 15:12:04,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:12:04,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719f170131463db4f7980c4ed2d93d4f91f, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719b91b11f8d5a648c8bdb7eaf5bf9c8138] mob files 2023-07-19 15:12:04,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719f170131463db4f7980c4ed2d93d4f91f 2023-07-19 15:12:04,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719b91b11f8d5a648c8bdb7eaf5bf9c8138 2023-07-19 15:12:04,418 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:04,423 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:04,418 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:04,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:04,419 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:04,424 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:04,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:04,423 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,424 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,424 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,424 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:04,424 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,424 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:04,424 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:04,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:04,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:04,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:04,424 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,424 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,517 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:04,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 15:12:04,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:12:04,519 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 15:12:04,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 15:12:04,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,613 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689779524214Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689779524478 (+264 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689779524478Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689779524479 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689779524521 (+42 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689779524547 (+26 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689779524613 (+66 ms) 2023-07-19 15:12:04,618 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 15:12:04,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 403 msec 2023-07-19 15:12:04,819 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:04,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 15:12:04,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:12:04,820 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820 2023-07-19 15:12:04,821 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44363, tgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820, rawTgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820, srcFsUri=hdfs://localhost:44363, srcDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:12:04,844 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:12:04,845 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_249034388_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,845 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983, snapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 15:12:04,850 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:04,885 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:04,885 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:04,886 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:04,886 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:05,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0005_000001 (auth:SIMPLE) 2023-07-19 15:12:06,044 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-6152129439566776643.jar 2023-07-19 15:12:06,045 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:06,045 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:06,131 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-2336543612822063214.jar 2023-07-19 15:12:06,132 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:06,132 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:06,133 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:06,133 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:06,133 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:06,134 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:06,134 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 15:12:06,135 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 15:12:06,135 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 15:12:06,135 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 15:12:06,136 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 15:12:06,136 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 15:12:06,137 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 15:12:06,137 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 15:12:06,137 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 15:12:06,138 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 15:12:06,138 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:12:06,139 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:12:06,139 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:12:06,140 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:12:06,140 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:12:06,141 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:12:06,142 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:12:07,610 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 15:12:08,058 WARN [Listener at jenkins-hbase4.apache.org/37699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 15:12:08,063 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 15:12:08,268 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:12:08,268 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:12:08,483 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0006_000001 (auth:SIMPLE) 2023-07-19 15:12:14,298 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0006_000001 (auth:SIMPLE) 2023-07-19 15:12:17,438 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 15:12:17,439 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 15:12:17,457 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:17,457 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 15:12:17,458 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 15:12:17,458 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:17,459 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 15:12:17,459 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 15:12:17,459 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:17,460 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 15:12:17,460 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779524820/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 15:12:17,468 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,475 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779537475"}]},"ts":"1689779537475"} 2023-07-19 15:12:17,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 15:12:17,477 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 15:12:17,479 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 15:12:17,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=867e2cc5fabcd9e83facdf880b88b94b, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ab101e7341f358bf2573430cead7cdf, UNASSIGN}] 2023-07-19 15:12:17,487 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=867e2cc5fabcd9e83facdf880b88b94b, UNASSIGN 2023-07-19 15:12:17,487 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ab101e7341f358bf2573430cead7cdf, UNASSIGN 2023-07-19 15:12:17,488 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=867e2cc5fabcd9e83facdf880b88b94b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:17,488 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779537488"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779537488"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779537488"}]},"ts":"1689779537488"} 2023-07-19 15:12:17,490 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9ab101e7341f358bf2573430cead7cdf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:17,490 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779537490"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779537490"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779537490"}]},"ts":"1689779537490"} 2023-07-19 15:12:17,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 867e2cc5fabcd9e83facdf880b88b94b, server=jenkins-hbase4.apache.org,37001,1689779417218}] 2023-07-19 15:12:17,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 9ab101e7341f358bf2573430cead7cdf, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:12:17,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 15:12:17,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:17,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9ab101e7341f358bf2573430cead7cdf, disabling compactions & flushes 2023-07-19 15:12:17,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:17,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:17,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. after waiting 0 ms 2023-07-19 15:12:17,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:17,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:17,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 867e2cc5fabcd9e83facdf880b88b94b, disabling compactions & flushes 2023-07-19 15:12:17,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:17,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:17,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. after waiting 0 ms 2023-07-19 15:12:17,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:17,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:12:17,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:12:17,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf. 2023-07-19 15:12:17,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9ab101e7341f358bf2573430cead7cdf: 2023-07-19 15:12:17,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:12:17,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:12:17,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b. 2023-07-19 15:12:17,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 867e2cc5fabcd9e83facdf880b88b94b: 2023-07-19 15:12:17,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:17,687 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9ab101e7341f358bf2573430cead7cdf, regionState=CLOSED 2023-07-19 15:12:17,687 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779537687"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779537687"}]},"ts":"1689779537687"} 2023-07-19 15:12:17,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:17,688 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=867e2cc5fabcd9e83facdf880b88b94b, regionState=CLOSED 2023-07-19 15:12:17,688 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689779537688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779537688"}]},"ts":"1689779537688"} 2023-07-19 15:12:17,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 15:12:17,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 9ab101e7341f358bf2573430cead7cdf, server=jenkins-hbase4.apache.org,44923,1689779417285 in 202 msec 2023-07-19 15:12:17,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9ab101e7341f358bf2573430cead7cdf, UNASSIGN in 217 msec 2023-07-19 15:12:17,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 15:12:17,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 867e2cc5fabcd9e83facdf880b88b94b, server=jenkins-hbase4.apache.org,37001,1689779417218 in 207 msec 2023-07-19 15:12:17,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-19 15:12:17,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=867e2cc5fabcd9e83facdf880b88b94b, UNASSIGN in 220 msec 2023-07-19 15:12:17,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779537703"}]},"ts":"1689779537703"} 2023-07-19 15:12:17,705 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 15:12:17,706 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 15:12:17,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 238 msec 2023-07-19 15:12:17,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 15:12:17,778 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 15:12:17,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,789 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,793 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,793 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,796 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,796 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,796 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,796 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 15:12:17,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 15:12:17,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 15:12:17,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 15:12:17,797 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:17,798 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:17,799 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,799 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,799 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:17,799 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:17,799 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,799 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:17,799 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,799 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:17,800 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/recovered.edits] 2023-07-19 15:12:17,800 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/recovered.edits] 2023-07-19 15:12:17,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 15:12:17,805 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/cf/401dcd925ae045198eb2515ba91721e3 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/cf/401dcd925ae045198eb2515ba91721e3 2023-07-19 15:12:17,808 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf/recovered.edits/9.seqid 2023-07-19 15:12:17,809 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/9ab101e7341f358bf2573430cead7cdf 2023-07-19 15:12:17,813 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/cf/bd06b3f36aac46998b18661f6dcd8111 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/cf/bd06b3f36aac46998b18661f6dcd8111 2023-07-19 15:12:17,816 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b/recovered.edits/9.seqid 2023-07-19 15:12:17,816 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testEmptyExportFileSystemState/867e2cc5fabcd9e83facdf880b88b94b 2023-07-19 15:12:17,816 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 15:12:17,817 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 15:12:17,820 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-19 15:12:17,823 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719f170131463db4f7980c4ed2d93d4f91f to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719f170131463db4f7980c4ed2d93d4f91f 2023-07-19 15:12:17,824 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719b91b11f8d5a648c8bdb7eaf5bf9c8138 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719b91b11f8d5a648c8bdb7eaf5bf9c8138 2023-07-19 15:12:17,825 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 15:12:17,827 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,829 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 15:12:17,832 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 15:12:17,833 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,833 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 15:12:17,833 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779537833"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:17,833 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779537833"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:17,835 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 15:12:17,835 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 867e2cc5fabcd9e83facdf880b88b94b, NAME => 'testtb-testEmptyExportFileSystemState,,1689779522682.867e2cc5fabcd9e83facdf880b88b94b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9ab101e7341f358bf2573430cead7cdf, NAME => 'testtb-testEmptyExportFileSystemState,1,1689779522682.9ab101e7341f358bf2573430cead7cdf.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 15:12:17,835 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 15:12:17,835 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689779537835"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:17,837 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 15:12:17,839 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 15:12:17,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 60 msec 2023-07-19 15:12:17,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 15:12:17,902 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 15:12:17,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 15:12:17,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:17,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 15:12:17,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 15:12:17,950 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 759) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:33861 from appattempt_1689779426270_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:58966 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_267502580_1 at /127.0.0.1:42820 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_907052920_17 at /127.0.0.1:42850 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:38538 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5032 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:38493 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=920 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=640 (was 509) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=1914 (was 2897) 2023-07-19 15:12:17,950 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 15:12:17,975 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=640, ProcessCount=180, AvailableMemoryMB=1911 2023-07-19 15:12:17,975 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 15:12:17,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 15:12:17,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:17,990 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 15:12:17,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 15:12:17,993 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 15:12:17,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 15:12:17,995 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:17,995 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:17,996 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9 empty. 2023-07-19 15:12:17,996 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410 empty. 2023-07-19 15:12:17,996 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:17,996 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:17,996 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 15:12:18,006 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 15:12:18,007 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 42e66fa0102c81efc2928d84bd8d56c9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:12:18,007 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 44ace7306c41f23c6259e906e2281410, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp 2023-07-19 15:12:18,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:12:18,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 42e66fa0102c81efc2928d84bd8d56c9, disabling compactions & flushes 2023-07-19 15:12:18,016 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. after waiting 0 ms 2023-07-19 15:12:18,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,016 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,016 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 42e66fa0102c81efc2928d84bd8d56c9: 2023-07-19 15:12:18,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:12:18,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 44ace7306c41f23c6259e906e2281410, disabling compactions & flushes 2023-07-19 15:12:18,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:18,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:18,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. after waiting 0 ms 2023-07-19 15:12:18,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:18,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:18,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 44ace7306c41f23c6259e906e2281410: 2023-07-19 15:12:18,024 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 15:12:18,025 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779538025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779538025"}]},"ts":"1689779538025"} 2023-07-19 15:12:18,025 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779538025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779538025"}]},"ts":"1689779538025"} 2023-07-19 15:12:18,027 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 15:12:18,028 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 15:12:18,028 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779538028"}]},"ts":"1689779538028"} 2023-07-19 15:12:18,029 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 15:12:18,032 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 15:12:18,033 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 15:12:18,033 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 15:12:18,033 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 15:12:18,033 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 15:12:18,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e66fa0102c81efc2928d84bd8d56c9, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44ace7306c41f23c6259e906e2281410, ASSIGN}] 2023-07-19 15:12:18,035 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44ace7306c41f23c6259e906e2281410, ASSIGN 2023-07-19 15:12:18,035 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e66fa0102c81efc2928d84bd8d56c9, ASSIGN 2023-07-19 15:12:18,036 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44ace7306c41f23c6259e906e2281410, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44923,1689779417285; forceNewPlan=false, retain=false 2023-07-19 15:12:18,036 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e66fa0102c81efc2928d84bd8d56c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43149,1689779417350; forceNewPlan=false, retain=false 2023-07-19 15:12:18,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 15:12:18,186 INFO [jenkins-hbase4:42601] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 15:12:18,189 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=42e66fa0102c81efc2928d84bd8d56c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,189 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=44ace7306c41f23c6259e906e2281410, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,190 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779538189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779538189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779538189"}]},"ts":"1689779538189"} 2023-07-19 15:12:18,190 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779538189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779538189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779538189"}]},"ts":"1689779538189"} 2023-07-19 15:12:18,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 42e66fa0102c81efc2928d84bd8d56c9, server=jenkins-hbase4.apache.org,43149,1689779417350}] 2023-07-19 15:12:18,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 44ace7306c41f23c6259e906e2281410, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:12:18,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 15:12:18,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:18,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44ace7306c41f23c6259e906e2281410, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 15:12:18,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42e66fa0102c81efc2928d84bd8d56c9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 15:12:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. service=AccessControlService 2023-07-19 15:12:18,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:12:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. service=AccessControlService 2023-07-19 15:12:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:12:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:18,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 15:12:18,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:18,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:18,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 15:12:18,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:18,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:18,354 INFO [StoreOpener-42e66fa0102c81efc2928d84bd8d56c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:18,355 INFO [StoreOpener-44ace7306c41f23c6259e906e2281410-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:18,355 DEBUG [StoreOpener-42e66fa0102c81efc2928d84bd8d56c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/cf 2023-07-19 15:12:18,355 DEBUG [StoreOpener-42e66fa0102c81efc2928d84bd8d56c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/cf 2023-07-19 15:12:18,356 INFO [StoreOpener-42e66fa0102c81efc2928d84bd8d56c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42e66fa0102c81efc2928d84bd8d56c9 columnFamilyName cf 2023-07-19 15:12:18,357 DEBUG [StoreOpener-44ace7306c41f23c6259e906e2281410-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/cf 2023-07-19 15:12:18,357 DEBUG [StoreOpener-44ace7306c41f23c6259e906e2281410-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/cf 2023-07-19 15:12:18,359 INFO [StoreOpener-44ace7306c41f23c6259e906e2281410-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44ace7306c41f23c6259e906e2281410 columnFamilyName cf 2023-07-19 15:12:18,360 INFO [StoreOpener-44ace7306c41f23c6259e906e2281410-1] regionserver.HStore(310): Store=44ace7306c41f23c6259e906e2281410/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:12:18,361 INFO [StoreOpener-42e66fa0102c81efc2928d84bd8d56c9-1] regionserver.HStore(310): Store=42e66fa0102c81efc2928d84bd8d56c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 15:12:18,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:18,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:18,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:18,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:18,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:18,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:18,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:12:18,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 44ace7306c41f23c6259e906e2281410; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75097919, jitterRate=0.11904619634151459}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:12:18,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 44ace7306c41f23c6259e906e2281410: 2023-07-19 15:12:18,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410., pid=109, masterSystemTime=1689779538344 2023-07-19 15:12:18,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 15:12:18,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 42e66fa0102c81efc2928d84bd8d56c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67238670, jitterRate=0.0019342601299285889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 15:12:18,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 42e66fa0102c81efc2928d84bd8d56c9: 2023-07-19 15:12:18,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:18,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:18,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9., pid=108, masterSystemTime=1689779538343 2023-07-19 15:12:18,376 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=44ace7306c41f23c6259e906e2281410, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,376 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779538376"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779538376"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779538376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779538376"}]},"ts":"1689779538376"} 2023-07-19 15:12:18,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,378 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=42e66fa0102c81efc2928d84bd8d56c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,378 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779538378"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689779538378"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689779538378"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689779538378"}]},"ts":"1689779538378"} 2023-07-19 15:12:18,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-19 15:12:18,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 44ace7306c41f23c6259e906e2281410, server=jenkins-hbase4.apache.org,44923,1689779417285 in 186 msec 2023-07-19 15:12:18,381 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44ace7306c41f23c6259e906e2281410, ASSIGN in 347 msec 2023-07-19 15:12:18,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-19 15:12:18,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 42e66fa0102c81efc2928d84bd8d56c9, server=jenkins-hbase4.apache.org,43149,1689779417350 in 188 msec 2023-07-19 15:12:18,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-19 15:12:18,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e66fa0102c81efc2928d84bd8d56c9, ASSIGN in 348 msec 2023-07-19 15:12:18,383 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 15:12:18,383 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779538383"}]},"ts":"1689779538383"} 2023-07-19 15:12:18,384 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 15:12:18,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 15:12:18,387 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 15:12:18,388 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 15:12:18,390 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:18,390 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:18,390 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:18,390 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:18,392 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:18,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:18,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:18,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 15:12:18,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 415 msec 2023-07-19 15:12:18,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 15:12:18,597 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 15:12:18,599 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,599 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,601 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:12:18,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 15:12:18,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779538611 (current time:1689779538611). 2023-07-19 15:12:18,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:12:18,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x1b5d9cf5 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:12:18,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73c7e3e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:12:18,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:18,631 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:18,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b5d9cf5 to 127.0.0.1:52285 2023-07-19 15:12:18,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:12:18,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x47e10959 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:12:18,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30ac8f64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:12:18,639 DEBUG [hconnection-0x7cb89a4d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:18,641 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:18,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:18,647 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:18,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47e10959 to 127.0.0.1:52285 2023-07-19 15:12:18,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:12:18,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 15:12:18,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:12:18,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 15:12:18,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 15:12:18,652 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 15:12:18,653 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689780138653 2023-07-19 15:12:18,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 15:12:18,653 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:12:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:12:18,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 15:12:18,656 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 15:12:18,657 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-19 15:12:18,658 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 15:12:18,659 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689780138659 2023-07-19 15:12:18,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,677 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 15:12:18,677 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:18,679 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 15:12:18,679 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 15:12:18,679 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,679 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,682 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:18,682 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:18,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:18,682 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:18,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:18,682 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:18,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,683 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,683 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,684 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,684 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 15:12:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 15:12:18,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 15:12:18,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 15:12:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:18,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 15:12:18,687 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:18,687 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 15:12:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 15:12:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 15:12:18,687 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 15:12:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 15:12:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 15:12:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 15:12:18,689 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 15:12:18,689 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 15:12:18,689 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 15:12:18,696 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,697 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:18,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:18,697 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:18,698 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,698 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:18,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 15:12:18,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b22b1d3[Count = 1] remaining members to acquire global barrier 2023-07-19 15:12:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:18,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 15:12:18,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b22b1d3[Count = 0] remaining members to acquire global barrier 2023-07-19 15:12:18,702 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 15:12:18,702 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,703 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,703 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,704 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 15:12:18,704 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:12:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:12:18,704 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 15:12:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 15:12:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:12:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,705 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 15:12:18,704 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. started... 2023-07-19 15:12:18,705 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42e66fa0102c81efc2928d84bd8d56c9: 2023-07-19 15:12:18,705 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,705 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:12:18,705 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:12:18,706 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:12:18,707 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:12:18,707 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:18,707 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. started... 2023-07-19 15:12:18,710 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,710 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:12:18,712 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 15:12:18,712 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:18,712 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 15:12:18,714 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44ace7306c41f23c6259e906e2281410: 2023-07-19 15:12:18,714 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,714 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:12:18,714 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 15:12:18,743 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. completed. 2023-07-19 15:12:18,743 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,743 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:12:18,743 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:12:18,744 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,744 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 15:12:18,744 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:12:18,745 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. completed. 2023-07-19 15:12:18,746 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:18,746 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:12:18,746 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:12:18,746 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,746 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 15:12:18,746 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:12:18,747 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,748 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 15:12:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:18,748 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:18,748 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 15:12:18,750 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,750 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 15:12:18,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:18,751 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:18,751 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 15:12:18,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:18,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,754 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:18,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 15:12:18,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:12:18,755 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:12:18,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43149,1689779417350': 2023-07-19 15:12:18,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 15:12:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:12:18,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 15:12:18,760 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 15:12:18,760 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:12:18,760 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:12:18,760 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,760 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:12:18,762 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,762 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,762 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,762 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:18,762 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:18,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:18,763 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,763 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,764 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,762 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:18,764 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:18,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:18,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,766 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,766 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:18,767 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,770 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,770 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:18,770 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:18,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:18,770 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:18,770 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:18,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:18,770 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:18,770 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:18,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:18,770 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:18,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:18,771 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,771 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,771 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,771 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:18,771 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,771 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:18,771 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:18,771 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:18,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,771 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:18,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:18,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:12:18,771 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 15:12:18,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,847 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 15:12:18,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,847 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689779538653Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689779538782 (+129 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689779538782Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689779538782Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689779538785 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689779538801 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689779538847 (+46 ms) 2023-07-19 15:12:18,850 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 15:12:18,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 197 msec 2023-07-19 15:12:18,956 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:18,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 15:12:18,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:12:18,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43149] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:12:18,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44923] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 15:12:18,962 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:18,963 DEBUG [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:18,963 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 15:12:18,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 15:12:18,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689779538972 (current time:1689779538972). 2023-07-19 15:12:18,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 15:12:18,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x3dd53c65 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:12:18,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@507a360, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:12:18,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:18,980 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:18,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3dd53c65 to 127.0.0.1:52285 2023-07-19 15:12:18,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:12:18,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x697d3d57 to 127.0.0.1:52285 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 15:12:18,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ddf0209, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 15:12:19,007 DEBUG [hconnection-0x457bb271-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:19,014 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:19,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 15:12:19,031 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 15:12:19,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x697d3d57 to 127.0.0.1:52285 2023-07-19 15:12:19,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:12:19,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 15:12:19,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 15:12:19,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 15:12:19,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 15:12:19,050 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 15:12:19,051 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689780139051 2023-07-19 15:12:19,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 15:12:19,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,053 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 15:12:19,053 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 15:12:19,054 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 15:12:19,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 15:12:19,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-19 15:12:19,057 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 15:12:19,057 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689780139057 2023-07-19 15:12:19,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,082 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 15:12:19,082 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:19,084 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 15:12:19,084 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 15:12:19,085 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,085 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,086 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:19,086 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:19,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:19,086 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:19,086 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:19,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:19,088 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,088 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,089 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,089 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 15:12:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,090 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 15:12:19,090 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 15:12:19,090 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:19,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 15:12:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 15:12:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 15:12:19,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37001,1689779417218' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 15:12:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 15:12:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 15:12:19,092 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 15:12:19,093 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 15:12:19,093 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 15:12:19,093 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 15:12:19,093 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 15:12:19,094 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 15:12:19,096 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,096 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,096 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,096 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,096 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:19,097 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:19,097 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,105 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:19,105 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,105 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:19,105 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 15:12:19,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:19,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:19,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44923,1689779417285' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 15:12:19,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43cb2f77[Count = 1] remaining members to acquire global barrier 2023-07-19 15:12:19,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:19,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:19,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:19,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:19,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:19,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43149,1689779417350' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 15:12:19,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43cb2f77[Count = 0] remaining members to acquire global barrier 2023-07-19 15:12:19,111 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 15:12:19,111 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 15:12:19,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,115 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 15:12:19,115 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,115 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:12:19,116 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:12:19,115 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 15:12:19,115 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 15:12:19,116 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37001,1689779417218' in zk 2023-07-19 15:12:19,116 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:19,116 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,116 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 15:12:19,116 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. started... 2023-07-19 15:12:19,116 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 42e66fa0102c81efc2928d84bd8d56c9 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 15:12:19,118 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 15:12:19,118 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 15:12:19,119 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:19,119 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 15:12:19,118 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:19,119 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. started... 2023-07-19 15:12:19,119 DEBUG [member: 'jenkins-hbase4.apache.org,37001,1689779417218' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 15:12:19,121 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 44ace7306c41f23c6259e906e2281410 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 15:12:19,154 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:19,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 15:12:19,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:12:19,156 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 15:12:19,174 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071902960be773ac492c89bc6359d97c1738 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071902960be773ac492c89bc6359d97c1738 2023-07-19 15:12:19,183 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307191f13bffce1e94e08a93f0412447d9e1a to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191f13bffce1e94e08a93f0412447d9e1a 2023-07-19 15:12:19,219 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/.tmp/cf/c70a2f158ec846fd8187988135c3f86e 2023-07-19 15:12:19,220 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/.tmp/cf/23a891c7eeee4e459f60e73cec817955 2023-07-19 15:12:19,227 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/.tmp/cf/c70a2f158ec846fd8187988135c3f86e as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/cf/c70a2f158ec846fd8187988135c3f86e 2023-07-19 15:12:19,227 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/.tmp/cf/23a891c7eeee4e459f60e73cec817955 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/cf/23a891c7eeee4e459f60e73cec817955 2023-07-19 15:12:19,233 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/cf/23a891c7eeee4e459f60e73cec817955, entries=5, sequenceid=6, filesize=5.8 K 2023-07-19 15:12:19,234 INFO [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 42e66fa0102c81efc2928d84bd8d56c9 in 118ms, sequenceid=6, compaction requested=false 2023-07-19 15:12:19,234 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 15:12:19,235 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42e66fa0102c81efc2928d84bd8d56c9: 2023-07-19 15:12:19,235 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,235 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:12:19,235 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/cf/23a891c7eeee4e459f60e73cec817955] hfiles 2023-07-19 15:12:19,235 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/cf/23a891c7eeee4e459f60e73cec817955 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,235 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/cf/c70a2f158ec846fd8187988135c3f86e, entries=45, sequenceid=6, filesize=13.0 K 2023-07-19 15:12:19,236 INFO [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 44ace7306c41f23c6259e906e2281410 in 116ms, sequenceid=6, compaction requested=false 2023-07-19 15:12:19,238 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44ace7306c41f23c6259e906e2281410: 2023-07-19 15:12:19,239 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,239 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 15:12:19,239 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/cf/c70a2f158ec846fd8187988135c3f86e] hfiles 2023-07-19 15:12:19,239 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/cf/c70a2f158ec846fd8187988135c3f86e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,307 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. completed. 2023-07-19 15:12:19,307 DEBUG [rs(jenkins-hbase4.apache.org,44923,1689779417285)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:19,307 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:12:19,307 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:12:19,307 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,307 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 15:12:19,307 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44923,1689779417285' in zk 2023-07-19 15:12:19,309 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 15:12:19,309 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,309 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:19,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:19,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:19,309 DEBUG [member: 'jenkins-hbase4.apache.org,44923,1689779417285' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 15:12:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:19,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:19,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44923,1689779417285': 2023-07-19 15:12:19,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44923,1689779417285' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 15:12:19,325 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. completed. 2023-07-19 15:12:19,325 DEBUG [rs(jenkins-hbase4.apache.org,43149,1689779417350)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:19,325 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 15:12:19,325 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 15:12:19,325 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,326 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 15:12:19,326 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43149,1689779417350' in zk 2023-07-19 15:12:19,327 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,328 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 15:12:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:19,328 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:19,328 DEBUG [member: 'jenkins-hbase4.apache.org,43149,1689779417350' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 15:12:19,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:19,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:19,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43149,1689779417350': 2023-07-19 15:12:19,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43149,1689779417350' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 15:12:19,334 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 15:12:19,334 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 15:12:19,334 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 15:12:19,334 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,334 INFO [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 15:12:19,338 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,338 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,338 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:19,338 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,338 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:19,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,338 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,338 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:19,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 15:12:19,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 15:12:19,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:19,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:19,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:19,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:19,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:19,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 15:12:19,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:19,340 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,341 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,341 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 15:12:19,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 15:12:19,343 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,344 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,344 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,349 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:19,349 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:19,349 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:19,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:19,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:19,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:19,349 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:19,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:19,351 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,351 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 15:12:19,351 DEBUG [(jenkins-hbase4.apache.org,42601,1689779415712)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 15:12:19,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:19,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:19,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 15:12:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 15:12:19,351 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:19,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191f13bffce1e94e08a93f0412447d9e1a, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071902960be773ac492c89bc6359d97c1738] mob files 2023-07-19 15:12:19,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191f13bffce1e94e08a93f0412447d9e1a 2023-07-19 15:12:19,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071902960be773ac492c89bc6359d97c1738 2023-07-19 15:12:19,356 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:19,352 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,356 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 15:12:19,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 15:12:19,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 15:12:19,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 15:12:19,358 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 15:12:19,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,440 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 15:12:19,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,440 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689779539051Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689779539373 (+322 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689779539373Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689779539373Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689779539380 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689779539406 (+26 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689779539440 (+34 ms) 2023-07-19 15:12:19,443 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 15:12:19,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 391 msec 2023-07-19 15:12:19,658 DEBUG [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 15:12:19,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 15:12:19,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 15:12:19,660 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659 2023-07-19 15:12:19,660 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44363, tgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659, rawTgtDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659, srcFsUri=hdfs://localhost:44363, srcDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:12:19,694 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983 2023-07-19 15:12:19,695 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1107059019_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,695 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44363, inputRoot=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983, snapshotDir=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 15:12:19,720 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:19,765 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:19,765 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:19,765 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:19,766 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:20,913 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-2439601171423254793.jar 2023-07-19 15:12:20,914 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:20,915 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:20,995 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/hadoop-5317255672488835620.jar 2023-07-19 15:12:20,996 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:20,996 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:20,997 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:20,997 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:20,998 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:20,998 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 15:12:20,999 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 15:12:20,999 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 15:12:21,000 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 15:12:21,000 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 15:12:21,000 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 15:12:21,001 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 15:12:21,001 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 15:12:21,002 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 15:12:21,002 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 15:12:21,003 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 15:12:21,004 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:12:21,004 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:12:21,005 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:12:21,005 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:12:21,006 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 15:12:21,006 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:12:21,007 DEBUG [Listener at jenkins-hbase4.apache.org/37699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 15:12:21,780 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0006_000001 (auth:SIMPLE) 2023-07-19 15:12:22,373 WARN [Listener at jenkins-hbase4.apache.org/37699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 15:12:22,375 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 15:12:22,377 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-19 15:12:22,484 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:12:22,485 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 15:12:22,804 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0007_000001 (auth:SIMPLE) 2023-07-19 15:12:23,348 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 15:12:28,706 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0007_000001 (auth:SIMPLE) 2023-07-19 15:12:31,022 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0007_000001 (auth:SIMPLE) 2023-07-19 15:12:35,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0007_000001 (auth:SIMPLE) 2023-07-19 15:12:36,685 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 15:12:36,685 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 15:12:36,705 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:36,705 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 15:12:36,706 INFO [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 15:12:36,706 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:36,707 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 15:12:36,707 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 15:12:36,707 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_435836725_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:36,708 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 15:12:36,708 DEBUG [Listener at jenkins-hbase4.apache.org/37699] snapshot.TestExportSnapshot(367): hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/export-test/export-1689779539659/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 15:12:36,715 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:36,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:36,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:36,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 15:12:36,722 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779556722"}]},"ts":"1689779556722"} 2023-07-19 15:12:36,724 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 15:12:36,726 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 15:12:36,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e66fa0102c81efc2928d84bd8d56c9, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44ace7306c41f23c6259e906e2281410, UNASSIGN}] 2023-07-19 15:12:36,729 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44ace7306c41f23c6259e906e2281410, UNASSIGN 2023-07-19 15:12:36,729 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e66fa0102c81efc2928d84bd8d56c9, UNASSIGN 2023-07-19 15:12:36,730 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=44ace7306c41f23c6259e906e2281410, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:12:36,730 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=42e66fa0102c81efc2928d84bd8d56c9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:12:36,730 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779556730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779556730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779556730"}]},"ts":"1689779556730"} 2023-07-19 15:12:36,730 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779556730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689779556730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689779556730"}]},"ts":"1689779556730"} 2023-07-19 15:12:36,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 44ace7306c41f23c6259e906e2281410, server=jenkins-hbase4.apache.org,44923,1689779417285}] 2023-07-19 15:12:36,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 42e66fa0102c81efc2928d84bd8d56c9, server=jenkins-hbase4.apache.org,43149,1689779417350}] 2023-07-19 15:12:36,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 15:12:36,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:36,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 42e66fa0102c81efc2928d84bd8d56c9, disabling compactions & flushes 2023-07-19 15:12:36,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:36,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:36,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. after waiting 0 ms 2023-07-19 15:12:36,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:36,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:36,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 44ace7306c41f23c6259e906e2281410, disabling compactions & flushes 2023-07-19 15:12:36,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:36,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:36,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. after waiting 0 ms 2023-07-19 15:12:36,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:36,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:12:36,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:12:36,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:12:36,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9. 2023-07-19 15:12:36,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:12:36,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 42e66fa0102c81efc2928d84bd8d56c9: 2023-07-19 15:12:36,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410. 2023-07-19 15:12:36,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 44ace7306c41f23c6259e906e2281410: 2023-07-19 15:12:36,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:36,913 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=42e66fa0102c81efc2928d84bd8d56c9, regionState=CLOSED 2023-07-19 15:12:36,913 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779556913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779556913"}]},"ts":"1689779556913"} 2023-07-19 15:12:36,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:36,914 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=44ace7306c41f23c6259e906e2281410, regionState=CLOSED 2023-07-19 15:12:36,914 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689779556914"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689779556914"}]},"ts":"1689779556914"} 2023-07-19 15:12:36,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-19 15:12:36,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 42e66fa0102c81efc2928d84bd8d56c9, server=jenkins-hbase4.apache.org,43149,1689779417350 in 178 msec 2023-07-19 15:12:36,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-19 15:12:36,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 44ace7306c41f23c6259e906e2281410, server=jenkins-hbase4.apache.org,44923,1689779417285 in 180 msec 2023-07-19 15:12:36,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42e66fa0102c81efc2928d84bd8d56c9, UNASSIGN in 191 msec 2023-07-19 15:12:36,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-19 15:12:36,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44ace7306c41f23c6259e906e2281410, UNASSIGN in 192 msec 2023-07-19 15:12:36,921 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689779556921"}]},"ts":"1689779556921"} 2023-07-19 15:12:36,922 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 15:12:36,923 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 15:12:36,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 209 msec 2023-07-19 15:12:37,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 15:12:37,025 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 15:12:37,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,031 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,031 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,033 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37001] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,040 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,040 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,040 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,041 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 15:12:37,042 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 15:12:37,043 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,043 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,043 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,043 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:37,043 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:37,043 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:37,043 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 15:12:37,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-19 15:12:37,044 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 15:12:37,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-19 15:12:37,044 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 15:12:37,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 15:12:37,045 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:37,046 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:37,048 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/recovered.edits] 2023-07-19 15:12:37,048 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/cf, FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/recovered.edits] 2023-07-19 15:12:37,063 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/cf/c70a2f158ec846fd8187988135c3f86e to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/cf/c70a2f158ec846fd8187988135c3f86e 2023-07-19 15:12:37,064 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/cf/23a891c7eeee4e459f60e73cec817955 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/cf/23a891c7eeee4e459f60e73cec817955 2023-07-19 15:12:37,068 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410/recovered.edits/9.seqid 2023-07-19 15:12:37,068 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44ace7306c41f23c6259e906e2281410 2023-07-19 15:12:37,068 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/recovered.edits/9.seqid to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9/recovered.edits/9.seqid 2023-07-19 15:12:37,069 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42e66fa0102c81efc2928d84bd8d56c9 2023-07-19 15:12:37,069 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 15:12:37,069 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 15:12:37,070 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-19 15:12:37,075 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191f13bffce1e94e08a93f0412447d9e1a to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307191f13bffce1e94e08a93f0412447d9e1a 2023-07-19 15:12:37,076 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071902960be773ac492c89bc6359d97c1738 to hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071902960be773ac492c89bc6359d97c1738 2023-07-19 15:12:37,077 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 15:12:37,079 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,082 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 15:12:37,083 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 15:12:37,084 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,084 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 15:12:37,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779557084"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:37,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689779557084"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:37,086 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 15:12:37,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 42e66fa0102c81efc2928d84bd8d56c9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689779537976.42e66fa0102c81efc2928d84bd8d56c9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 44ace7306c41f23c6259e906e2281410, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689779537976.44ace7306c41f23c6259e906e2281410.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 15:12:37,086 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 15:12:37,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689779557086"}]},"ts":"9223372036854775807"} 2023-07-19 15:12:37,088 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 15:12:37,090 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 64 msec 2023-07-19 15:12:37,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 15:12:37,146 INFO [Listener at jenkins-hbase4.apache.org/37699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 15:12:37,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 15:12:37,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 15:12:37,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 15:12:37,185 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 760) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:37699 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1301062674_1 at /127.0.0.1:42572 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5674 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1549691202) connection to jenkins-hbase4.apache.org/172.31.14.131:33249 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:42588 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1107059019_17 at /127.0.0.1:58944 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1301062674_1 at /127.0.0.1:52226 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x41920ffa-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_435836725_17 at /127.0.0.1:52248 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=656 (was 640) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=1110 (was 1911) 2023-07-19 15:12:37,186 WARN [Listener at jenkins-hbase4.apache.org/37699] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 15:12:37,186 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 15:12:37,209 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 15:12:41,602 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689779426270_0007_000001 (auth:SIMPLE) 2023-07-19 15:12:42,487 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 15:12:51,344 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 15:13:05,476 ERROR [Thread[Thread-412,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 15:13:05,477 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 15:13:05,493 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 15:13:05,512 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 15:13:05,514 ERROR [Thread[Thread-422,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 15:13:05,555 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 15:13:05,660 ERROR [Thread[Thread-386,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 15:13:05,660 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 15:13:05,660 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 15:13:05,660 INFO [Listener at jenkins-hbase4.apache.org/37699] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 15:13:05,660 DEBUG [Listener at jenkins-hbase4.apache.org/37699] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x163e546e to 127.0.0.1:52285 2023-07-19 15:13:05,660 DEBUG [Listener at jenkins-hbase4.apache.org/37699] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:13:05,661 DEBUG [Listener at jenkins-hbase4.apache.org/37699] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 15:13:05,661 DEBUG [Listener at jenkins-hbase4.apache.org/37699] util.JVMClusterUtil(257): Found active master hash=491258214, stopped=false 2023-07-19 15:13:05,661 DEBUG [Listener at jenkins-hbase4.apache.org/37699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,661 DEBUG [Listener at jenkins-hbase4.apache.org/37699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 15:13:05,661 INFO [Listener at jenkins-hbase4.apache.org/37699] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:13:05,665 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 15:13:05,665 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 15:13:05,666 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 15:13:05,666 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 15:13:05,666 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:13:05,666 INFO [Listener at jenkins-hbase4.apache.org/37699] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 15:13:05,666 DEBUG [Listener at jenkins-hbase4.apache.org/37699] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7342e769 to 127.0.0.1:52285 2023-07-19 15:13:05,666 DEBUG [Listener at jenkins-hbase4.apache.org/37699] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:13:05,667 INFO [Listener at jenkins-hbase4.apache.org/37699] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37001,1689779417218' ***** 2023-07-19 15:13:05,667 DEBUG [Listener at jenkins-hbase4.apache.org/37699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 15:13:05,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 15:13:05,667 INFO [Listener at jenkins-hbase4.apache.org/37699] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 15:13:05,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 15:13:05,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 15:13:05,667 INFO [Listener at jenkins-hbase4.apache.org/37699] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44923,1689779417285' ***** 2023-07-19 15:13:05,668 DEBUG [Listener at jenkins-hbase4.apache.org/37699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,668 INFO [Listener at jenkins-hbase4.apache.org/37699] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 15:13:05,668 INFO [Listener at jenkins-hbase4.apache.org/37699] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43149,1689779417350' ***** 2023-07-19 15:13:05,668 DEBUG [Listener at jenkins-hbase4.apache.org/37699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,668 INFO [Listener at jenkins-hbase4.apache.org/37699] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 15:13:05,668 INFO [RS:1;jenkins-hbase4:44923] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 15:13:05,668 INFO [RS:1;jenkins-hbase4:44923] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 15:13:05,668 INFO [RS:1;jenkins-hbase4:44923] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 15:13:05,668 INFO [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:13:05,669 DEBUG [RS:1;jenkins-hbase4:44923] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ec33ceb to 127.0.0.1:52285 2023-07-19 15:13:05,669 DEBUG [RS:1;jenkins-hbase4:44923] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:13:05,668 INFO [RS:0;jenkins-hbase4:37001] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 15:13:05,672 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 15:13:05,672 INFO [RS:0;jenkins-hbase4:37001] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 15:13:05,672 INFO [RS:1;jenkins-hbase4:44923] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 15:13:05,672 INFO [RS:1;jenkins-hbase4:44923] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 15:13:05,672 INFO [RS:1;jenkins-hbase4:44923] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 15:13:05,672 INFO [RS:2;jenkins-hbase4:43149] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 15:13:05,672 INFO [RS:0;jenkins-hbase4:37001] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 15:13:05,672 INFO [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 15:13:05,672 INFO [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(3305): Received CLOSE for 71ed98883a9e46dde234461e579e9825 2023-07-19 15:13:05,672 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 15:13:05,673 INFO [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:13:05,673 DEBUG [RS:0;jenkins-hbase4:37001] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4458162a to 127.0.0.1:52285 2023-07-19 15:13:05,672 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 15:13:05,672 INFO [RS:2;jenkins-hbase4:43149] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 15:13:05,673 DEBUG [RS:0;jenkins-hbase4:37001] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:13:05,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 71ed98883a9e46dde234461e579e9825, disabling compactions & flushes 2023-07-19 15:13:05,673 INFO [RS:2;jenkins-hbase4:43149] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 15:13:05,674 INFO [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 15:13:05,674 INFO [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(3305): Received CLOSE for b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:13:05,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:13:05,675 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 15:13:05,674 INFO [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 15:13:05,676 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 15:13:05,676 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-19 15:13:05,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5972380c30d7cbe06bbdbc0d63cca35, disabling compactions & flushes 2023-07-19 15:13:05,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:13:05,675 INFO [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:13:05,676 DEBUG [RS:2;jenkins-hbase4:43149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c7e15f9 to 127.0.0.1:52285 2023-07-19 15:13:05,674 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1478): Online Regions={71ed98883a9e46dde234461e579e9825=hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825.} 2023-07-19 15:13:05,676 DEBUG [RS:2;jenkins-hbase4:43149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:13:05,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. after waiting 0 ms 2023-07-19 15:13:05,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:13:05,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 71ed98883a9e46dde234461e579e9825 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 15:13:05,677 DEBUG [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 15:13:05,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:13:05,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:13:05,676 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 15:13:05,678 INFO [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 15:13:05,678 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 15:13:05,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. after waiting 0 ms 2023-07-19 15:13:05,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:13:05,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b5972380c30d7cbe06bbdbc0d63cca35 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 15:13:05,677 DEBUG [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1504): Waiting on 71ed98883a9e46dde234461e579e9825 2023-07-19 15:13:05,678 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 15:13:05,678 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1478): Online Regions={b5972380c30d7cbe06bbdbc0d63cca35=hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35.} 2023-07-19 15:13:05,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 15:13:05,679 DEBUG [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1504): Waiting on b5972380c30d7cbe06bbdbc0d63cca35 2023-07-19 15:13:05,690 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 15:13:05,693 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 15:13:05,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35/.tmp/info/39fcc38b47a645bf858bb59290bd0152 2023-07-19 15:13:05,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825/.tmp/l/d25ce0b722b04fb797334685e9b08cd4 2023-07-19 15:13:05,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/.tmp/info/1230a80ded2d4e01888c9b208d728cae 2023-07-19 15:13:05,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d25ce0b722b04fb797334685e9b08cd4 2023-07-19 15:13:05,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825/.tmp/l/d25ce0b722b04fb797334685e9b08cd4 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825/l/d25ce0b722b04fb797334685e9b08cd4 2023-07-19 15:13:05,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35/.tmp/info/39fcc38b47a645bf858bb59290bd0152 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35/info/39fcc38b47a645bf858bb59290bd0152 2023-07-19 15:13:05,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1230a80ded2d4e01888c9b208d728cae 2023-07-19 15:13:05,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d25ce0b722b04fb797334685e9b08cd4 2023-07-19 15:13:05,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825/l/d25ce0b722b04fb797334685e9b08cd4, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 15:13:05,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 71ed98883a9e46dde234461e579e9825 in 56ms, sequenceid=18, compaction requested=false 2023-07-19 15:13:05,748 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 15:13:05,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35/info/39fcc38b47a645bf858bb59290bd0152, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 15:13:05,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b5972380c30d7cbe06bbdbc0d63cca35 in 72ms, sequenceid=6, compaction requested=false 2023-07-19 15:13:05,765 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/.tmp/rep_barrier/6e90b4242f8344728ba17e1ef18f2dc6 2023-07-19 15:13:05,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/acl/71ed98883a9e46dde234461e579e9825/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 15:13:05,774 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e90b4242f8344728ba17e1ef18f2dc6 2023-07-19 15:13:05,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:13:05,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 71ed98883a9e46dde234461e579e9825: 2023-07-19 15:13:05,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689779420937.71ed98883a9e46dde234461e579e9825. 2023-07-19 15:13:05,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/namespace/b5972380c30d7cbe06bbdbc0d63cca35/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 15:13:05,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:13:05,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5972380c30d7cbe06bbdbc0d63cca35: 2023-07-19 15:13:05,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689779420174.b5972380c30d7cbe06bbdbc0d63cca35. 2023-07-19 15:13:05,808 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/.tmp/table/486daf6665d74bc390cb5bc97ec6d239 2023-07-19 15:13:05,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 486daf6665d74bc390cb5bc97ec6d239 2023-07-19 15:13:05,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/.tmp/info/1230a80ded2d4e01888c9b208d728cae as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/info/1230a80ded2d4e01888c9b208d728cae 2023-07-19 15:13:05,822 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1230a80ded2d4e01888c9b208d728cae 2023-07-19 15:13:05,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/info/1230a80ded2d4e01888c9b208d728cae, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 15:13:05,823 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/.tmp/rep_barrier/6e90b4242f8344728ba17e1ef18f2dc6 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/rep_barrier/6e90b4242f8344728ba17e1ef18f2dc6 2023-07-19 15:13:05,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e90b4242f8344728ba17e1ef18f2dc6 2023-07-19 15:13:05,829 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/rep_barrier/6e90b4242f8344728ba17e1ef18f2dc6, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 15:13:05,830 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/.tmp/table/486daf6665d74bc390cb5bc97ec6d239 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/table/486daf6665d74bc390cb5bc97ec6d239 2023-07-19 15:13:05,834 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 486daf6665d74bc390cb5bc97ec6d239 2023-07-19 15:13:05,834 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/table/486daf6665d74bc390cb5bc97ec6d239, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 15:13:05,835 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 156ms, sequenceid=131, compaction requested=false 2023-07-19 15:13:05,847 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 15:13:05,847 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,847 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 15:13:05,848 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 15:13:05,848 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 15:13:05,848 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 15:13:05,877 INFO [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44923,1689779417285; all regions closed. 2023-07-19 15:13:05,879 INFO [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37001,1689779417218; all regions closed. 2023-07-19 15:13:05,879 INFO [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43149,1689779417350; all regions closed. 2023-07-19 15:13:05,893 DEBUG [RS:1;jenkins-hbase4:44923] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/oldWALs 2023-07-19 15:13:05,893 INFO [RS:1;jenkins-hbase4:44923] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44923%2C1689779417285.meta:.meta(num 1689779419778) 2023-07-19 15:13:05,893 DEBUG [RS:2;jenkins-hbase4:43149] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/oldWALs 2023-07-19 15:13:05,893 INFO [RS:2;jenkins-hbase4:43149] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43149%2C1689779417350:(num 1689779419554) 2023-07-19 15:13:05,893 DEBUG [RS:2;jenkins-hbase4:43149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:13:05,893 INFO [RS:2;jenkins-hbase4:43149] regionserver.LeaseManager(133): Closed leases 2023-07-19 15:13:05,893 INFO [RS:2;jenkins-hbase4:43149] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 15:13:05,894 INFO [RS:2;jenkins-hbase4:43149] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 15:13:05,894 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 15:13:05,894 INFO [RS:2;jenkins-hbase4:43149] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 15:13:05,894 INFO [RS:2;jenkins-hbase4:43149] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 15:13:05,895 DEBUG [RS:0;jenkins-hbase4:37001] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/oldWALs 2023-07-19 15:13:05,895 INFO [RS:0;jenkins-hbase4:37001] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37001%2C1689779417218:(num 1689779419554) 2023-07-19 15:13:05,895 DEBUG [RS:0;jenkins-hbase4:37001] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:13:05,895 INFO [RS:0;jenkins-hbase4:37001] regionserver.LeaseManager(133): Closed leases 2023-07-19 15:13:05,895 INFO [RS:0;jenkins-hbase4:37001] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 15:13:05,896 INFO [RS:2;jenkins-hbase4:43149] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43149 2023-07-19 15:13:05,898 INFO [RS:0;jenkins-hbase4:37001] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 15:13:05,898 INFO [RS:0;jenkins-hbase4:37001] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 15:13:05,898 INFO [RS:0;jenkins-hbase4:37001] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 15:13:05,900 INFO [RS:0;jenkins-hbase4:37001] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37001 2023-07-19 15:13:05,900 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 15:13:05,903 DEBUG [RS:1;jenkins-hbase4:44923] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/oldWALs 2023-07-19 15:13:05,903 INFO [RS:1;jenkins-hbase4:44923] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44923%2C1689779417285:(num 1689779419543) 2023-07-19 15:13:05,903 DEBUG [RS:1;jenkins-hbase4:44923] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:13:05,903 INFO [RS:1;jenkins-hbase4:44923] regionserver.LeaseManager(133): Closed leases 2023-07-19 15:13:05,903 INFO [RS:1;jenkins-hbase4:44923] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 15:13:05,903 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 15:13:05,904 INFO [RS:1;jenkins-hbase4:44923] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44923 2023-07-19 15:13:05,904 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,905 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:13:05,905 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 15:13:05,905 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 15:13:05,905 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,905 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:13:05,905 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 15:13:05,905 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37001,1689779417218 2023-07-19 15:13:05,905 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 15:13:05,905 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 15:13:05,905 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 15:13:05,905 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 15:13:05,906 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:13:05,906 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:13:05,906 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43149,1689779417350 2023-07-19 15:13:05,907 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:13:05,907 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:13:05,907 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44923,1689779417285 2023-07-19 15:13:05,914 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44923,1689779417285] 2023-07-19 15:13:05,914 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44923,1689779417285; numProcessing=1 2023-07-19 15:13:05,915 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44923,1689779417285 already deleted, retry=false 2023-07-19 15:13:05,916 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44923,1689779417285 expired; onlineServers=2 2023-07-19 15:13:05,916 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43149,1689779417350] 2023-07-19 15:13:05,916 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43149,1689779417350; numProcessing=2 2023-07-19 15:13:05,917 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43149,1689779417350 already deleted, retry=false 2023-07-19 15:13:05,917 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43149,1689779417350 expired; onlineServers=1 2023-07-19 15:13:05,917 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37001,1689779417218] 2023-07-19 15:13:05,917 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37001,1689779417218; numProcessing=3 2023-07-19 15:13:05,919 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37001,1689779417218 already deleted, retry=false 2023-07-19 15:13:05,919 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37001,1689779417218 expired; onlineServers=0 2023-07-19 15:13:05,919 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42601,1689779415712' ***** 2023-07-19 15:13:05,919 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 15:13:05,919 DEBUG [M:0;jenkins-hbase4:42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c750b5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 15:13:05,919 INFO [M:0;jenkins-hbase4:42601] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42601,1689779415712 2023-07-19 15:13:05,919 INFO [M:0;jenkins-hbase4:42601] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42601,1689779415712; all regions closed. 2023-07-19 15:13:05,919 DEBUG [M:0;jenkins-hbase4:42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 15:13:05,919 DEBUG [M:0;jenkins-hbase4:42601] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 15:13:05,919 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 15:13:05,919 DEBUG [M:0;jenkins-hbase4:42601] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 15:13:05,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689779418977] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689779418977,5,FailOnTimeoutGroup] 2023-07-19 15:13:05,920 INFO [M:0;jenkins-hbase4:42601] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 15:13:05,920 INFO [M:0;jenkins-hbase4:42601] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 15:13:05,920 INFO [M:0;jenkins-hbase4:42601] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 15:13:05,920 DEBUG [M:0;jenkins-hbase4:42601] master.HMaster(1512): Stopping service threads 2023-07-19 15:13:05,920 INFO [M:0;jenkins-hbase4:42601] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 15:13:05,920 ERROR [M:0;jenkins-hbase4:42601] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 15:13:05,921 INFO [M:0;jenkins-hbase4:42601] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 15:13:05,921 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 15:13:05,923 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 15:13:05,923 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 15:13:05,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689779418987] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689779418987,5,FailOnTimeoutGroup] 2023-07-19 15:13:05,925 DEBUG [M:0;jenkins-hbase4:42601] zookeeper.ZKUtil(398): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 15:13:05,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 15:13:05,925 WARN [M:0;jenkins-hbase4:42601] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 15:13:05,925 INFO [M:0;jenkins-hbase4:42601] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 15:13:05,926 INFO [M:0;jenkins-hbase4:42601] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 15:13:05,926 DEBUG [M:0;jenkins-hbase4:42601] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 15:13:05,926 INFO [M:0;jenkins-hbase4:42601] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 15:13:05,926 DEBUG [M:0;jenkins-hbase4:42601] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 15:13:05,926 DEBUG [M:0;jenkins-hbase4:42601] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 15:13:05,926 DEBUG [M:0;jenkins-hbase4:42601] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 15:13:05,927 INFO [M:0;jenkins-hbase4:42601] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.67 KB heapSize=451.98 KB 2023-07-19 15:13:05,948 INFO [M:0;jenkins-hbase4:42601] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.67 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6f95e5510a424bc580167d4af8102c05 2023-07-19 15:13:05,952 INFO [M:0;jenkins-hbase4:42601] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f95e5510a424bc580167d4af8102c05 2023-07-19 15:13:05,953 DEBUG [M:0;jenkins-hbase4:42601] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6f95e5510a424bc580167d4af8102c05 as hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6f95e5510a424bc580167d4af8102c05 2023-07-19 15:13:05,957 INFO [M:0;jenkins-hbase4:42601] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f95e5510a424bc580167d4af8102c05 2023-07-19 15:13:05,958 INFO [M:0;jenkins-hbase4:42601] regionserver.HStore(1080): Added hdfs://localhost:44363/user/jenkins/test-data/1304fd05-4aa9-c991-4711-271fb1205983/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6f95e5510a424bc580167d4af8102c05, entries=119, sequenceid=899, filesize=28.6 K 2023-07-19 15:13:05,959 INFO [M:0;jenkins-hbase4:42601] regionserver.HRegion(2948): Finished flush of dataSize ~375.67 KB/384687, heapSize ~451.97 KB/462816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=899, compaction requested=false 2023-07-19 15:13:05,960 INFO [M:0;jenkins-hbase4:42601] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 15:13:05,960 DEBUG [M:0;jenkins-hbase4:42601] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 15:13:05,966 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 15:13:05,966 INFO [M:0;jenkins-hbase4:42601] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 15:13:05,966 INFO [M:0;jenkins-hbase4:42601] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42601 2023-07-19 15:13:05,968 DEBUG [M:0;jenkins-hbase4:42601] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42601,1689779415712 already deleted, retry=false 2023-07-19 15:13:06,014 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 15:13:06,014 INFO [RS:0;jenkins-hbase4:37001] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37001,1689779417218; zookeeper connection closed. 2023-07-19 15:13:06,014 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:37001-0x1017e2229d90001, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 15:13:06,014 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@49f266a9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@49f266a9 2023-07-19 15:13:06,114 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 15:13:06,114 INFO [M:0;jenkins-hbase4:42601] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42601,1689779415712; zookeeper connection closed. 2023-07-19 15:13:06,114 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e2229d90000, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 15:13:06,215 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 15:13:06,215 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:43149-0x1017e2229d90003, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 15:13:06,215 INFO [RS:2;jenkins-hbase4:43149] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43149,1689779417350; zookeeper connection closed. 2023-07-19 15:13:06,216 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@411f05fb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@411f05fb 2023-07-19 15:13:06,315 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 15:13:06,315 INFO [RS:1;jenkins-hbase4:44923] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44923,1689779417285; zookeeper connection closed. 2023-07-19 15:13:06,315 DEBUG [Listener at localhost/42995-EventThread] zookeeper.ZKWatcher(600): regionserver:44923-0x1017e2229d90002, quorum=127.0.0.1:52285, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 15:13:06,315 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@782eaa11] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@782eaa11 2023-07-19 15:13:06,316 INFO [Listener at jenkins-hbase4.apache.org/37699] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 15:13:06,316 WARN [Listener at jenkins-hbase4.apache.org/37699] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 15:13:06,322 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 15:13:06,323 WARN [273560320@qtp-2147257890-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44029] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-19 15:13:06,323 WARN [273560320@qtp-2147257890-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44029] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-19 15:13:06,428 WARN [BP-175566966-172.31.14.131-1689779411180 heartbeating to localhost/127.0.0.1:44363] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 15:13:06,428 WARN [BP-175566966-172.31.14.131-1689779411180 heartbeating to localhost/127.0.0.1:44363] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-175566966-172.31.14.131-1689779411180 (Datanode Uuid 720bed41-b1a2-4ebd-91d3-f3ef54e26928) service to localhost/127.0.0.1:44363 2023-07-19 15:13:06,430 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data5/current/BP-175566966-172.31.14.131-1689779411180] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 15:13:06,430 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data6/current/BP-175566966-172.31.14.131-1689779411180] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 15:13:06,433 WARN [Listener at jenkins-hbase4.apache.org/37699] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 15:13:06,436 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 15:13:06,541 WARN [BP-175566966-172.31.14.131-1689779411180 heartbeating to localhost/127.0.0.1:44363] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 15:13:06,541 WARN [BP-175566966-172.31.14.131-1689779411180 heartbeating to localhost/127.0.0.1:44363] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-175566966-172.31.14.131-1689779411180 (Datanode Uuid f06f41f9-9c3c-487e-9965-9c3b387fa5c2) service to localhost/127.0.0.1:44363 2023-07-19 15:13:06,541 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data3/current/BP-175566966-172.31.14.131-1689779411180] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 15:13:06,542 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data4/current/BP-175566966-172.31.14.131-1689779411180] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 15:13:06,543 WARN [Listener at jenkins-hbase4.apache.org/37699] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 15:13:06,555 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 15:13:06,660 WARN [BP-175566966-172.31.14.131-1689779411180 heartbeating to localhost/127.0.0.1:44363] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 15:13:06,660 WARN [BP-175566966-172.31.14.131-1689779411180 heartbeating to localhost/127.0.0.1:44363] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-175566966-172.31.14.131-1689779411180 (Datanode Uuid 0d8a5728-1f78-4aaf-b1bf-f5d1b2ec118a) service to localhost/127.0.0.1:44363 2023-07-19 15:13:06,661 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data1/current/BP-175566966-172.31.14.131-1689779411180] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 15:13:06,661 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d8e642e7-7877-e872-6030-7c023b195134/cluster_85a85cba-0987-2069-03d9-855a514dde25/dfs/data/data2/current/BP-175566966-172.31.14.131-1689779411180] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 15:13:06,694 INFO [Listener at jenkins-hbase4.apache.org/37699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 15:13:06,828 INFO [Listener at jenkins-hbase4.apache.org/37699] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 15:13:06,950 INFO [Listener at jenkins-hbase4.apache.org/37699] hbase.HBaseTestingUtility(1293): Minicluster is down